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After learning this chapter you will be able to: 


[=] Understand the essential characteristics of DevOps including building a culture of 
shared responsibility, transparency, and embracing failure. 
m) Study the concepts like importance of Continuous Integration and Continuous 


Delivery, Infrastructure as Code, Test Driven Development, Behaviour Driven 
Development. 


m) Study essential DevOps concepts and use of it. 


m) Understand the organizational impact of DevOps tools, and their use in the Linux 
operating system. 


aa INTRODUCTION a AA 


° “Many times, we hear from software developers that they do DevOps or use DevOps 
tools means that are using two words : development and operations. DevOps culture is 
different from traditional corporate culture; it typically requires a change in mindset, 
processes and tools. This is linked with Continuous Integration (CI) and Continuous 
Delivery (CD) practices with IaC (Infrastructure as Code), 

e The term DevOps (Development and Operations) is a collection of tools and 
technologies combined to carry out various business processes. The purpose is to 
bridge the gap between the development department, and the operations department 
which are two of the most important departments in any IT organization. 


Define DevOps 


e Definition: DevOps (a combination of two words such as “development” and 
“operations”) is the combination of practices and tools designed to increase an 
organization's ability to deliver applications and services faster than traditional’ 
software development processes. 


(1.1) 


SDLC: 


iy Introduction to Devo s 


/WHATIS DevOps? z 
| " and "Ops" refers to replacing siloed Development ang 
eate multidisciplinary teams that now work together with 
s and tools. Essential DevOps practices include agile 
continuous delivery, and monitoring of 


e The contraction of "Dev 
Operations. The idea is to cr’ 
shared and efficient practice 
planning, continuous integration, 

icati i t journey. 
lications. DevOps 15 a constan P 
T DevOps philosophy focuses on breaking away from traditionally siloed teams in 
e 


software development to adopt a more collaborative approach. Under the DevOps 
model, development and operations teams work together throughout the project 


lifecycle, from development to deployment. 


Development 


Fig. 1.1: DevOps Model 
SDLC MODELS, LEAN, ITIL, AGILE 


e The focus of the IT industry has been changed to continuous integration and’ 


deployment approach. There is a constant need for upgrading and integrating the 
solution with the existing software to meet the market demands. Therefore, owing t0 
a continuous delivery approach, the communication between stakeholders involved 
in developing a software solution and the end-users has increased more than evel 
due to which there is a constant need for feedback and its implementation. 


ane began with Waterfall model but is gradually shifting to other models and finally 
pproaching the Agile DevOps and Lean methodologies. 


Sof i E 
& So Development Life Cycle (SDLC) is a waterfall model which contains 
itional methodology for software development 
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The rigid nature of the development process in ‘SDLC makes it impossible to revert to 


_ the previous stage of development, and the model has become ‘outdated as a result of 


the ever-evolving nature of software development, where implementation must be 

continually updated in accordance with user feedback in order to meet the evolving 

requirements of the IT sector. 

Let’s see some of the few modern software development models that are widely used 

in the industry today. 

Lean Model: 

The concept of lean software development derived its presence in the IT industry 
from Toyota manufacturing. Toyota production system was the first company to 
introduce the lean development process in the mid-20th century to improve their car 
production and reduce wastage of time and resources. : 

Lean Model followed by many manufacturing sectors, across various industries. This 
approach was first executed in software development in 2003. 


Why Lean model nsed in software? 


There are various reasons for the popularity of Lean methodology in the IT industry 

such as: i ‘ 

o Itallows frequent product changes and software releases. 

o Shorter development lifecycle. 

o Continuous exchange of preliminary development steps. 

o Simultaneous improvement in development quality, time and soon 

These are some of the notable factors that make the lean development model essential 

for organizations that want to keep up with the current pace of. software 

development. 

Agile Model: 

Agile is a continuous integration and deployment approach which is iterative in 

nature, It develops its principles from Lean methodology. Some of the agile 

approaches can be attributed to the following concepts: 

o Frequent analysis and implementation of changes. 

o Team-oriented leadership or specifically ownership of tasks by each member of 
the team. l 

o Itis usually very self-organized and responsible for its deliverables. 

o Agile perfectly supports organizational and customer expectations. 

Agile Process: Following are the various processes that are used to implement Agile 

Process: ; l 

(a) Scrum: This process of agile development focuses on a team-driven development 
environment. The team is composed of 7 to 9 members, usually, with major roles 
and responsibilities classified as a Scrum Master, Product Owner, and Scrum 
Team. The three roles can be explained further as follows: 
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ember is responsible for organizing the team an 


ter: This m 
Scrum Mas tion gaps or any other gap about the task being 


eliminating communica 
delivered. 
product Owner: This membe 
prioritizing the backlog, and ensuring 
iteration. 
o s ae i es is responsible for completing the allocated tasks 
within a sprint, by a self-organized and collaborative approach. 


[e] 


r is responsible for creating a product backlog 
that the designated tasks are completed 


Some of the Scrum Practices are listed as follows: 


o Sprint Planning: In this type of planning, the team discusses the product 
backlog, initial plan of action, and the tasks to be completed during this 


sprint. 


o Daily Scrum Meets: Daily scrum meetings refer to the daily morning 


meetings, usually time-boxed for 15 minutes, where they discuss their plan of 
action for the day. 

o Sprint Review Meeting: This type of review meeting refers to a meeting 
where completion of the planned course of action is discussed and monitored 
to determine the future course of actions needed to accomplish any 
bottlenecks. Ae 

o Sprint Retrospective Meets: This is the last phase and the last scrum meeting. 
In this phase, the overall development strategies are discussed regarding the 
scope of solution implementation, identification of bottlenecks, the success of 


planned courses, and any other scope of improvement, which could be 


adopted in future projects, are discussed. 
(b) Crystal Methodologies: This methodology includes the interaction between 


people, more than processes and tools. This method also includes the approaches 


accepted by the team according to the scope of a project. 

(c) Dynamic Software Development Method (DSDM): This methodology is also 
referred to as a Rapid Action Development Model. In th the users are involved 
actively in the development of the project. Teams are em 
making capabilities. 

(d) Feature-driven Development (FDD: This is a feature-driven methodology, where 
each phase involves completing a small feature within the given time. It consists 
of design walk-through and code inspection,andsoon, ` 

(e) Lean Software Development - Lean software development includes just-in-time’ 
production techniques. This methodology targets to eliminate waste and reduce 


Bay that way increasing the efficiency of the entire software development 
SS. 


powered with decision- 


(f) Extreme programming (XP) - Extreme programming methodology is very useful 
in situations where there are frequent release cycles, shorter development phases, 
and uncertainties relating to the functionality to be developed. 

ITIL ( Information Technology Infrastructure Library): 


ITIL provides the framework and organized processes, while Lean reminds team 
members to reduce waste (for IT, this is in the form of time and non-utilized talent) 
and Agile helps team members to work more quickly and adapt to change. 

For example, think of an IT service desk handling ticket pileups due to Covid. They 
likely are using incident management through ITIL v3/2011 or ITIL 4, which keeps 
teams working through tickets in the same way. But, when they add in Lean, it might 


_ look like the team is reducing downtime by re-prioritizing tickets. Add in a bit of Agile 


and the tickets might be routed to people outside of the IT service desk who are 
equipped to handle specific types of issues, or it might look like a group tackling 
problems and implementing feedback loops. 

Individually, these methodologies work to update support and service delivery, but 
combined they can boost it to ‘the next level It should be noted, that you don’t 
necessarily need all three to be successful, but you can find success within the 
combination. Together, Lean, ITIL, and Agile offer: 

o Faster resolution of issues. 

o Improved productivity for agents. 

o A better overall customer experience. 

o Reduction in wasted time and ultimately, money. 


WHY DevOps? 


DevOps is used to increase an organization’s speed at the time of delivering 
applications and services. Many companies have successfully implemented DevOps to 
enhance their user experience including Amazon, Netflix, etc. 


. Facebook's mobile app is updated every two weeks effectively which tells users you 


can have what you want and you can have it. It is the DevOps philosophy that helps 
Facebook ensure that apps are not outdated and that users get the best experience on 
Facebook. Facebook achieves this true code ownership model that makes its 
developers responsible which includes testing and supporting through production 
and delivery for each kernel of code. They write and update their true policies like this 
but Facebook has developed a DevOps culture and has successfully enhanced its 
development lifecycle. 

Industries have started to prepare for digital transformation by shifting their means 
to weeks and months instead of years while maintaining high quality as a result. 
DevOps is the solution for all this. 


DevOps Lifecycle: 


Introduction to De 
16 
s MCA t- Sem. 
m traditional IT because traditional IT has 1000s lines of 
nt teams with different standards but DevOps is created 


edge of the product. Traditional IT is complex to 


The DevOps is different fro 
code and is created by differe 
by one team with intimate knowl 
understand while DevOps is easily understandable. 


DevOps Lifecycle is the ; ; 
together to bring products to market more efficiently and quickly. The DevOps 


lifecyge consists of various phases such as Plan, Code, Building, Test, Releasing, 
Deploying, Operating, and Monitoring. 


Fig. 12: DevOps Lifecycle 


c Plan: The first step of planning is determining the commercial needs and: 


gathering the opinions of end-user by professionals. 


c Code: The code for the same is developed and in order to simplify the design, the 3 


team of developers uses tools and extensions that take care of security problems. 


Build: $ 
© Build: After the coding part, programmers use various tools for the submission of — 


the code to the common code source. 


Test: i ; ? 
i level ae Ae ea nica t as software integrity should be assured at this 
Safety Testin phase, Various types of tests such as User Acceptability Testing. 
2 Speed Testing, and many more will be done. 
Release: At this level, everything is read 
environment. 
© Deploy: In this level, Infrastructure- 
infrastructure and sub 
lifecycle tools. 


o 


methodology where professional development teams come 


y to be deployed in the operational ; 


as-Code assists in creating the operational 
sequently publishes the build using various DevOps — 
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o Operate: At this level, the available version is ready for users to use. Here, the 
department looks after the server configuration and deployment. 

o Monitor: The observation is done at this level that depends on the data which is 
gathered from consumer behaviour, the efficiency of applications, and from 
various other sources. 

Best practices to follow when using DevOps: 

e Implement an automated dashboard which gives run-time information about the 
development of product stages. 

e As it keeps the entire team together which is good for collaboration and 
communication. 

e Allow DevOps to bea cultural change within the organization. 

e Be patient with the developers when using DevOps. 

e Maintain a centralized unit for storage. 

e Build a flexible infrastructure as it can access at any time anywhere with the help of 
internet. 

Advantages: 

1. Faster Delivery: It enables organizations to release new products and updates 
faster and more frequently, which can lead to a competitive advantage. 

2. Improved Collaboration: DevOps promotes collaboration between development 
and operations teams, resulting in better communication, increased efficiency, 
and reduced friction. 

3. Improved Quality: DevOps emphasizes automated testing and continuous 

' integration, which helps to catch bugs early in the development process and 
improve the overall quality of software. 

4. Increased Automation: DevOps enables organizations to automate many manual 
processes, freeing up time for more strategic work and reducing the risk of 
human error. 

5. Better Scalability: DevOps enables organizations to quickly and efficiently scale 
their infrastructure to meet changing demands, improving the ability to respond 
to business needs. 

6. Increased Customer Satisfaction: DevOps helps organizations to deliver new 
features and updates more quickly. This can result in increased customer 
satisfaction and loyalty. 

7. Improved Security: DevOps promotes security best practices, such as continuous 
testing and monitoring, which can help to reduce the risk of security breaches 
and improve the overall security of an organization's systems. 

8. Better Resource Utilization: DevOps enables organizations to improve their use 
of resources, including hardware, software, and personnel. which can result in 


cost savings and improved efficiency. 
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Disadvantages: 

4. High Initial Investmen 
process, requiring signi 
personnel. 

2, skills Shortage: Finding qualified D 
organizations may need to invest int 
the necessary skills within their teams. 


3, Resistance to Change: ; 
organizational changes required for successful DevOps adoption. This can result 


in resistance, resistance to collaboration, and reduced efficiency. 

4. Lack of Standardization: DevOps is still a relatively new field, and there is a lack 
of standardization in terms of methodologies, tools, and processes. This can make 
it difficult for organizations to determine the best approach for their specific 
needs, 

5, Increased Complexity: DevOps can increase the complexity of software delivery, 


t: Implementing 


ficant investment in technology, infrastructure, and 


evOps professionals can be a challenge, and 
raining and development programs to build 


requiring organizations to manage a larger number of moving parts and integrate — 


multiple systems and tools. 


6. Dependency on Technology: DevOps relies heavily on technology, and 
organizations may need to invest in a variety of tools and platforms to support — 


the DevOps process, 


7. Need for Continuous Improvement: As new technologies and best practices _ 
emerge, DevOps requires constant improvement and adaptation. Organizations 


must be prepared to continudusly adapt and evolve their DevOps practices to — 


remain competitive, 


HISTORY OF DevOps 3 me 


* DevOps term introduced in 2007-2009 by Patrick Debois, Gene Kim, and John Willis, It 
represents the combination of Development (Dev) and Operations (Ops). It is à 


movement that promotes bringing developers and operations together within teams: 


This is to be able to deliver added business v 
alue to users m nce be 
more competitive in the market, ore quickly and he 


This is the set of practices that reduce the obstacles be 
want to code upd 
stability and qu 
which reduces 


DevOps can be a complex and Coste 


Some employees may resist the cultural ang 
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1.6 | DevOps Stakeholders : 


e DevOps stakeholders are not limited to software developers and IT operations 
professionals. DevOps stakeholders include people from another party, within the 
organization as well as people from other organization. Also, people involve in 
designing and developing software products and services, delivering and managing 
software products and services. All these peoples work together to improve the flow 
of value across the end-to-end IT value chain. Many of the Dev stakeholders who are 
involved in designing and developing products and services are upstream from the 
developers themselves and so influence the work that they do. 

e Dev includes all people involved in developing software products and services 
including but not exclusive to: 

o Architects, Business Representatives, Customers, Product Owners, Project 
Managers, Quality Assurance (QA), Testers and Analysts, Suppliers. 

e Ops Includes all people involved in delivering and managing software products and 
services including but not exclusive to: 

o Information Security Professionals, Systems Engineers, System Administrators, 
IT Operations Engineers, Release Engineers, Database Administrators (DBAs), 
Network Engineers, Support Professionals, Third Party Vendors and Suppliers. 


2.7 | DevOps Tools 


e “The ultimate goal of DevOps in any organization is to help optimize the flow of 
business value from the conception of the business Idea to the end-product at the 
hands of the user; all the while encouraging greater collaboration between the 
stakeholders involved.” 

1. Ensures effective collaboration between teams: Effective collaboration In any 
process depends on shared ownership, During the development process, all people 
involved should note the fact that everyone is equally responsible for the entire 
development process, Whether it is development, testing, or deployment, each 
team member should be involved. They should understand that they have an 
equal stake in the final outcome. In the DevOps paradigm, the passing of work 
from one team to another is completely defined and broken down. This 
accelerates the entire process of development since collaboration between all the 
teams involved is streamlined. 

2. Create scalable infrastructure platforms: DevOps is used to create a supportable 
infrastructure for applications that make them highly scalable. To fit into the 
modern world demands of any business, scalable apps have become an absolute 
necessity. The process of scaling should be reliable and fully automated. As a 
result, the app will have the ability to adapt to any situation when a marketing 
effort goes viral. With the app being scalable, it can adjust itself to large traffic 
volumes and provide perfect user experience. 


Introdu 
4.10 ction to Devons 


lease capabilities: Every company must give an importance 
‘releasable’ state. Continuous delivery of Software 
to add new features and go live at any Stage 


DevOps aims to automate the process of release o has a 
plethora of advantages. Automated release management is pr A ast, and 
very consistent. Moreover, through automation, companies can release new 
versions as per their requirements. Automated release ir aks also he 
complete and thorough audit trials, as these are essential for compliance 
purposes. E 
4. Provides faster feedback: Automating repetitive tasks suc as testing and 
reporting will always increase the speed of feedback. Since the development team 
will know what has to change, it can roll out the updated version faster. In 
“addition, the team can better understand the impact of the changes that it has - 


done in the software lifecycle. A real understanding of changes will assist team 
king efficiently in collaboration. With fast feedback mechanism, 


members in wor. 
the operations team and developers can make better decisions collectively and 


improve the app’s performance. 
IMPORTANT TERMINOLOGY. 


Table 1.1: Terminology 


An Agent is a program residing on particular physical servers to 
execute multiple processes on that very server. 

Agile Software 

Development 
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3. Builds on-demand re i 
for keeping their software 1n a 
product will allow the software 


Er 
a | 


A philosophy and methodology for software development, with an 
importance on user feedback, the quality of software, and the 
capability of fast response to new product requirements and other 
changes. 


Application 
Release _ 

Automation 
(ARA) 


Behavior-Driven 
Development 
(BDD) 


The deployment of software releases to several different 
environments and their configurations, but with minimal human 
involvement. : 


An Agile software development methodology that encourages 
collaboration and teamwork between software developers, Quality 
Assurance, and business participants in any given software project. 


alete used in continuous integration that can be installed 
ocal'y or remotely, depending on the server: The agent sends and 
recelves messages relating to the creation of software builds. 


‘contd... 


Capacity Test This test determines the user capacity that a computer, server, or 
application can support right before failing. 
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Canary Release 
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Referencing how canaries were brought into coal mines to test the 
air. This is a go-live strategy where a new application version gets 
released to a small batch of production servers, then monitored 
closely to determine if it runs as it’s supposed to. If the’ version 
proves, to be stable, it’s rolled out to all of the production 
environment, 


Commit _ A means of recording changes to a repository, then adding a log 
message, is outlining the same changes. 


Configuration When uncommitted hotfixes and manual changes are applied to 
Drift software and hardware configurations, the latter becomes 
inconsistent with the master version. This is often a common 
reason for technical debt. 


| An engineering process for creating consistent system settings, 
including physical attributes, performance, and function, as well as 
keeping them that way. This is meant to keep a system associated 
with its initial design, requirements, and operational information. 


An operating system (OS) level method of virtualization employed 


for the deployment and running of distributed applications 
without having to launch an entire virtual machine for every use. 


A software package is a standardized unit that includes everything 
needed to run the software, including code and dependencies. 
Containers-enable an application to run in a fast and reliable 
manner when it’s moved from one computing environment to 
| another. 

An approach to software engineering in which integration, 
automated testing, and automated deployment capabilities 
continuously allow new software to be repeatedly developed and 
deployed swiftly and with a high degree of reliability, but with little | 
human intervention. 
A development practice for software releases in which every code 
commit that passes through automated testing is sent to the 
production environment, which results in a large number of daily 
production deployments. It accomplishes the same tasks as 
Continuous Delivery does, but the former is fully automated, 
completely removing the human element. 


Configuration 
Management 


Containerization 


Containers 


Continuous 
Delivery 


Continuous 
Deployment 


contd. ... 
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ment practice where developers merge ll 
AR d repository often ;, 0f 
e into a share ën, iq 

of cod cally 
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A software develop 
their working copies 
several times a day. 


Continuous 
Integration 


— arocess that involves finding and fixing any Software|. 
A systemic sie 4 bugs during, every part of the Software 
se cycle. It is considered a part of both the Continuoys 
eal and continuous delivery processes. 


Continuous 
Quality 


The process of running automated tests as part of the software 
e ae 

e pipeline across all environments to obtain imme diate 
feedback on the code builds quality. 


Dark Launch A development strategy in which a new version of the code, one 
that implements new features, 1S released to your team ora subse 
of the organization’s users, but is either not visibly activated or is 
only partially so. This process is similar toa Canary Release, . 

Deployment 


Deployment 
Pipeline 


DevSecOps 


Event-Driven 
Architecture 


Continuous 
Testing 


The bringing together of all the processes necessary to that make 
hardware or a software program available for use, which includes 
all installations, configuring, testing, and moving that program to 
its home environment. 


An automated multi-step process that takes software from version 
control to making it available to an organization’s users. 


A fusion of the words “development” and “operations”. It describes 
a design philosophy where development and operations teams 
collaborate on software development and deployment. The goal of 


this new process is to increase software production agility while 
achieving business goals. | 


Ths process of bringing security into DevOps methodology and 
giving it a significant role, 


A software architecture pattern where 
messages or events, and is b 
other events. l 


the system both produces 
uilt to react to, consume, and detect 


Exploratory 
Testing 
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This term means "the real place" in Japanese, and in the context of 
the business world, it often means “where value is created.” 


Issue Tracking A process where programmers and quality assurance experts can 


track the flow of both defects and new features, starting at 
identification and concluding with resolution. 


Lead Time In the world of manufacturing, this is the time involved in moving 


a work in progress (WIP) to a finished state. In the world of DevOps, 
the context changes to moving code changes to production. 


Mean Time 


A calculation of the average amount of system downtime resulting 
between, 


from failures. It measures the reliability of a given system or 
Failures (MTBF) | components. 
MeanTimeto ` | The average amount of time needed for a system or component to 
Recovery (MTTR) | recover from failure and be returned to production status. 
Microservices A pattern of architectural design wherein complex applications is 


composed of a suite of smaller modular services or components 
that communicate with each other using language-agnostic APIs. 


Production _ | The last stage in the software deployment pipeline, where the target 
audience will finally use the application. 


Regression 
Testing.. 


The testing of a software application to confirm that any recent 


changes made to an application haven’t adversely affected any 
features that were already in place. 


Release 


Using tools such as XL Release to manage software releases, taking 
' Orchestration 


them from the development stage to the actual software release. 
This includes the definition, automation, security, monitoring, and 
control of the manual and automated tasks 


Rollback Returning a database or program to a previous state, either 
; manually or automatically. 


Source Control Also called Revision Control or Version Control. This is a process for | 
: storing, tracking, and managing changes to. code, documents, 
websites, and other pieces of information. This is usually achieved 
by generating branches off of the software's stable master version, 
then merging the stable feature branches back into the latter. 


This is an almost copy of a production environment for software 
| testing, It is used to test the newest software iteration before it goes 
live, using an environment that mimics live production as close as 
possible. 


Staging 
Environment 


contd. ... 
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development works that result when an easi] 
aa code is used in the short run, rather than the 
im 


lication of the best overall solution. In other words, the cost ofa 
app 


short-cut. 


| Technical debt 
| 


Galized software (apart from the software being tested) to 


. e e 
| Test Automation | Using Sp d compare actual outcomes against 


control the execution of tests an 
predicted outcomes. 


A testing strategy that involves isolating the smallest unit of 


Unit Testin 
i testable code is separated apart from the rest of the software and 
running tests on it to see if it functions as it’s supposed to. 
: he 
DevOps PERSPECTIVE | 


e DevOps is the group of cultural philosophies, practices, and tools that increases an 


organization's skill to deliver applications and services at high velocity: evolving and- 
improving products at a faster pace than organizations using traditional software 


development and infrastructure management processes. ` 

Business Perspective: 

e Every business person should know what DevOps is all about. It is a group of concepts 
that automates the processes between IT teams and software development. It provides 
an ability to solve critical issues quickly, fast software releases, increased trust and 
faith, and better management of unplanned work. 

e In simple words, it is collaboration between development and operations which 
focuses on tighter integration. 

DevOps can be beneficial for any business; 


Through DevOps, developers can infuse in the opportunity to work more efficiently 
with stakeholders, and operations. 

o Masao Release spe smarter Deployment of new system and applications. 

o Continuous Integration and Continuous Delivery i 
o Production cycles are often coordinated w 

effective and streamlined, 

o Faster time-to-market and delivery times that i 
o Process Automation and Security Maintenance 


DevOps Perspective of Infrastructure and Environment 
ent: 


* Theoretically DevOps is very si 
Ty simple b : 
Information Technology Opeldtlons i ut practically Software Development ant 


edt 
DevOps consists of the following sete o be combined. Implementation process 0 


ith IT mechanisms to make them more 


mprove Return on Investment. 
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Creation of DevOps Infrastructure: 

Implementation of the first step is to create the DevOps infrastructure on which the 

application will run. Doing so is not easy task. There should not be a lack of co- 

operation between the development and the operations team. Both work in two 
different groups and silos. Developers want to deliver changes as soon as possible and 
the operations team, on the other hand, aims for stability. 

Developers and IT professionals must bring all changes with stability together and 

ensure they work towards the common goal of our stakeholders, i.e. releasing 

valuable software as soon as possible with minimum risk involved. There should be a 

continuous delivery pipeline so that both the development and the operation team 

can work together without any kind of confusion. 4 

Following are some of the small changes that can be done to do this goal: 

o Developers should audit any smallest change made to the deployment 
environment so that if anything goes wrong, the problem can be traced out easily. 

o Strong monitoring systems should be set to alert the development and operations 
team on time if any abnormal event occurs. This will minimize the downtime if 
anything goes wrong. 

o An application logs a WARNING every time a connection is unexpectedly closed or 
timed out, INFO or DEBUG every time a connection is closed. 

o Operation team can test the scenario if anything goes wrong so that the same 
thing can be prevented from happening again in the future. 

o Involvement of the operations team in the organizational IT service continuity 
plan right from the start. ; 

o For creating the DevOps infrastructure, technology with which the operations 
team is well-familiar should be used so that they can easily own and manage the 
environment. 

Modeling & Managing the DevOps Infrastructure: 

Management is the main thing after creating DevOps infrastructure. Many times 

companies do not have complete control over the selection of Infrastructure but 

people can fully automate the build, integration, testing, and deployment process. At 
this phase, some questions may come in mind such as: 

o What provisions will be done for DevOps infrastructure? 

o How to deploy and configure various bits of software that form our 
infrastructure? 

o Howto manage our infrastructure once the provisioning and configuration? 

Everything needed:to create and maintain the infrastructure, such as operating 

system install definitions, configuration for data center automation tools like Puppet, 

general infrastructure configurations like DNS files & SMTP settings, and the scripts 
for managing the infrastructure will be kept under the version control. 


All these files in version CO i changes is t0 


job in case of infrastruc rag changes will be Bin 99 all'the applications Gem 
frastru ‘ronment. 
o Verify that the in roduction environ ! 
they are pushed E the pee environment and the testing environmen 
the pP 
o Push changes t0 © 
ns team. 
managed by the ne the successfull deployment of the new infrastructys, 
o Perform tests for ens 
on the application. : ent: 
cture Environmen” . : 
Management of DevOps oe things for managing the DevOps infrastructy, 
e We will need the follow 
environment: A 
cture: 
; to the DevOps Infrastru l 
e For sae: ee snthatnoonecall make changes without approval. 
o Contro e access r 
o F to the infrastructure. 
> Defining an automated process to soe etal imë 
o Monitoring the infrastructure to detect and fix issues on time. 


e For making changes to the DevOps Infrastructure: 
if it is about updating the firewall or 


o Even the smallest change no matter 1 
deploying a new version of the software. It should be run through the same 


change management process. 
o The DevOps Infrastructure modification process s 
single ticketing system everyone can log into. 
Changes should be logged as they are so that they can be easily audited. 
Everyone should be able to view the history of changes in every environment. 
Anyone needs to test the changes in a production-like testing environment before 
pushing them live. a 
Apply all the DevOps infrastructure changes to the version control first and then 
apply them through the automated process. 

o Run tests to verify if the changes we made have worked or not. 
3. Managing the Server Provisioning and Configuration: 
Server provisioning & Server configurati in smal 

ti ; m 
EE GEER guration management is often overlooked in sr 
(a) Server Provisi ; SA 
oning: In Server Provisioning, 


rial 
essal a a set of resources like app!°? 
network ta and software are taken to build a server and make it ready 
ork operation. Typical tasks d 


from a pool of available serye uring server provisioning are selecting 4 se 
configuring the system mik i ading appropriate software, customizing 
changing its parameters, ging a boot image for the server, and 


hould be managed througha 


e -¢o 


Oo 


= 
SIES 
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(b) Virtualization: Virtualization is the fundamental support of the cloud which 
enables thousands of hosts to virtually access servers over the internet. A virtual 
machine competes with a physical machine. Following will be the benefits of 
virtualization: 

o Fastresponse to the changing environment 
o Consolidation 

o Hardware standardization 

o Baselines can be easily maintained 

(c) Ongoing Server Management: After installing the operating system, the 
company needs to ensure full control over the configuration. They should not 
change in an uncontrolled manner. Nobody should be able to log into the 
deployment environment except the operations team and no change should be 
done without an automated system. We also need to apply OS service packages, 
upgrade, install new software, change necessary settings, and perform 
deployments. 

Parallel Testing with Virtual Environments: We need to run parallel tests in the 

deployment pipeline to see if everything is running smoothly in the production 

environment or if there are any issues. 


(d 


— 


. Managing Data: 


A set of problems in Data management & organization while implementing the 
DevOps infrastructure might be faced. These are: 
There is a large volume of data involved which makes it impossible to keep track 
of each data involved in software development 
o The lifecycle of application data is different from other parts of the system. 
One way to avoid this problem and effectively manage data is to delete the previous 
version or replace the old version with a new copy. However, doing so is not possible 
in real-time scenarios. Every single bit of data is important. There can be scenarios 
when we might need to roll back to a previous state due to some issues. In that case, 
we will still need the older versions of the data. So, we will need some advanced 
approaches for data management such as: 

(a) Database Scripting: One great way to manage data in DevOps Infrastructure is to 
capture all database initialization and migration as scripts and check into version 
control. Then, we can use these scripts to manage every database used in the 
delivery process. However, we need to make sure all the database scripts are 
managed effectively so that there is no issue while retrieving data from the 


databases. 


° 
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5. 


; ost challenging however crucia 

(b) Deploying a Database anne s OANGE an BOR Site, pie of 
managing the a sure that the application works as it should a 
a ae is where the deployment of a database takes place. This is what 
happens when we deploy a database again: 
o Theold version of the data is erased. 
o The new database structure, instances, and schemas are created. 
o Finally, the data is loaded into the database. 

Incremental Change: 

Incremental change is another effective technique to manage DevOps infrastructure 

data. It ensures an application keeps working even after we are making changes to it 

which is an important pre-requisite of continuous integration (cl). On the other hand 

Continuous delivery demands the successful deployment of every software release, 

including the changes to the database into production. This means we must update 

the entire operational database while retaining the valuable data held in it. So, we 
need an efficient rollback strategy 50 that we can easily take back control of things if 
anything goes wrong. 

For this, we must follow the following data migration strategies: 

(a) Database Versioning: It is one of the 
migration in an automated fashion. All we 
which contains its version number. Now, 
database, we will have to create two scripts: 


most efficient mechanisms for data 
need is to create a table in the database 
every time we make a change to the 


o Aroll-forward script that takes the database from version x to version x+1. 
o Aroll-backward script that takes the database from version x+1 to version x. 


Another thing we will need is an application configuration setting which 
specifies the version of the database with which it is designed to work. 


Then during the deployment, we can use a tool which looks at the current 
version of the database and the database version required by the application 


version being deployed. Then this tool will use the roll-forward or roll- 


backward scripts to align both the application and the database version. 
correctly. We can read about database scripting in detail here. 


(b) Managing Orchestrated Changes: This is another common practice for data 
migration. We are not in favor of it because it would be better if applications 
could communicate directly, not through the database. Still, many companies are 
following this practice and integrating all applications through a single database. . 
Be cautious when doing the same because even a small change to the database can 


have a negative impact on how other applications work. We should test such 


changes in an orchestrated environment before implementing them in the 
production environment. | 


IN 


| 
: 
| . 
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(c) Rolling Back the Databases: With the help of roll-forward and roll-backward 
scripts, it is easy to use an application at the deployment time to migrate the 
existing database to its correct version without losing any data. 

Another effective data migration strategy is to perform both the database 
migration process from the application deployment process independently. This 


will also make sure data migration is done without data loss or any change in the 
application behaviour. 


6. Configuration Management: 


' manage things: 


Configuration management is another crucial step in DevOps infrastructure 
management in which we ensure that all the files and software which we are 


expecting on the machine are available, configured correctly, and working as 
intended. 


Managing configuration manually is simple for a single machine. However, when we 
are handling five or ten servers with which 100-200 computers are connected - 
configuration management becomes a nightmare. That’s why we need a better way to 


(a) Version Control: Version control is responsible for recording changes to a file ora 


set of files over time so that we can easily remember specific versions later on. It 
is a good practice because if we know the previous versi 


ons of files, we can easily 
roll back to the earlier versions of the project. Version control can also help us 
recover in case we make mistakes and screw up things. 


Best practices for Version Control: 


o Use version control for everything (source code, tests, databas 


e scripts, builds 
& deployment scripts, documentation, 


libraries, and configuration files). 
o Check in regularly to see if all the versions are working properly. 


o Use detailed multi-p aragraph commit messages during check-in. This can save 


hours of debugging in case any error occurs later. 
(b) Managing Components and Dependencies: 


1. Managing External Libraries: Since external libraries come in binary form, 
managing them can be a difficult task. Here are two ways we can get this 
done: 

o Check the external libraries into the version control. 


ò Declare the external libraries and use a tool like Maven or Ivy to down them 
from the Internet repositories to our artifact repository. 

2. Managing Components: The best way is to 
components. This will limit the scope of the 
regression bugs, encourage reuse, 
development process on large projects. 


divide the application into smaller 
changes to the application, reduce 
and enable a much more efficient 


~w 
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ing Software Configuration: Software configuration should be managed 
j SAR should subject it to proper management § testing, and consider a 
aan software configuration principles such se l 
o Keepallthe available application configuration options 1n the same repository. 
as its source code. 
> Manage the values of configurations separately. 
Perform configurations using an automated process with the help of values 
taken from the configuration repository. 
Use clear naming conventions to avoid confusion. 


o 


o 

o Donotrepeat any information. 

o Keepthe configuration information as simple as possible. 

o Do not over-engineer or over-optimize the configuration system. 

o Runall necessary configuration tests and keep a record of each. 
e That is how we establish a DevOps infrastructure management and software 
deployment environment. The process requires a lot of patience and guidance 
because there are many chances, things could go wrong. 


DevOps AND AGILE 


e Agility is the key-Additionally, through DevOps, scalability can be achieved quickly 
and easily even for big organizations with a Stable and reliable operating 
environment, pushing one’s business to stay ahead of the competition. 


e Agile helps in bridging the gap between Business and Development teams and DevOps 
helps in doing this for Development and Operations teams. 

e Agile refers to an iterative approach which focuses on collaboration, customer 
feedback, and small, rapid releasés, DevOps is the practice of bringing development 
and operations teams together. DevOps central concept is to manage end-to-end 
engineering processes (Concept to Cash). 

Difference between DevOps and Agile: 


* DevOps and Agile are two software development strategies having similar aims for 
product development, delivery end to end. 


Table 1.2: Key difference between DevOps and Agile 


Agile 
Definition DevOps is a practice of bringing | Agile refers to the continuous 
development and operation | iterative approach, which 
teams together. focuses on collaboration, 
customer feedback, small, and 


rapid releases. 
contd. ..- 


dbi 
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Purpose É DevOps purpose is to manage | The agile purpose is to manage 
end to end engineering | complex projects. 
processes. 


Task It focuses on constant testing | It focuses on constant changes. 
and delivery. 


It has a large team’size as it | It has a small team size. As 


involves all the stack holders. smaller the team, the fewer 
people work on it so that they 
Team Skillset 


can move faster. 
DevOps divides and spreads the | Agile development emphasizes 
skill set - between the | training all team members to 
development and the operation | have a wide variety of similar 
and equal skills. 


focused on | Agile can implement within a 
collaboration, so it does not have | range of tactical frameworks 


any commonly accepted | such as safe, scrum, and sprint. 
framework. 


Duration The ideal goal is to deliver the | Agile development is managed 
code to production daily or | in units of sprints. This time is 
every few hours. _ | much less than a month for 
i each sprint. 

and fast delivery. i 

Feedback Feedback comes from the|In Agile, feedback is coming 
< internal team. from the customer. 
It supports both variations left 
Principle |. and right. 


nee rome Agile focuses on. functional and 
and business readiness. non-functional readiness. 
In DevOps, developing, testing, Developing software is inherent 
and implementation all are 
equally important. 


to Agile. 
Quality DevOps contributes to creating 

better quality with automation 

and early bug removal. 

Developers need to follow 

Coding and best Architectural 

practices to maintain quality 

standards. 


Implementation | DevOps ` is 


Agile produces better 
applications suites with the 
desired requirements. It can 
quickly adapt according to the 
changes made on time during 
the project life. 


contd. ... 
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N 
E AELA T ee 
Deras = ma a : 
Ansible, | Bugzilla, Kanboard, and JIRA 


Ws, 
| Tools le prude wee are | are some popular Agile tools. 
popular Devops tools. : : 
“automation is the primary goal | Agile does not emphasize on the 
of Devops R works on the | automation. 
f maximizing | 


1. Puppet: 

e Puppet is the most widely used DevOps tool. It allows the delivery and release of 
technology changes quickly and frequently. It has features of versioning, automated 
testing, and continuous delivery. It enables to manage entire infrastructure as code 
without expanding the size of the team. 


prindple of 
ic ae tovi 
efficiency waen deploying | Features: 


Real-time context-aware reporting. 

o Modeland manage the entire environment. 

o Defined and continually enforce infrastructure. 

o Desired state conflict detection and remediation. 

o Itinspects and reports on packages running across the infrastructure. 
o Iteliminates manual work for the software delivery process. 

It helps the developer to deliver great software quickly. 

2. Ansible: 


Ansible is a leading DevOps tool. Ansible is an open-source IT engine that automates 
application deployment, cloud-provisioning, intra-service orchestration, and other IT 


9 


aoit rare. 
munication | DevOps 
invalves Spe | | 
ocuments. tis essential for the 
> s 

operational team to fully | 
ng the software release | 
$ 


Scrum is the most common 
method of implementing Agile 
| software development. Scrum 
meeting is carried out daily. i 


communication 
and design 


understand th 


na its network implications for | 

the enough running the í 

denlovment process. | 

Docamentation m DevOps the process | The agile method gives priority 
documentation is prime because | to the working system over 

it will send the softwere to an complete documentation. It is 

ideal when you are flexible and 


(9) 


operationa tem for 
Geployment Automation | responsive. However, it can tools. It makes it easier for DevOps teams to scale automation and speed up 


minimises the impact of/ harm when you are trying to 
insufiicent documentation. | turn things over to. another 
However, in the development of | team for deployment. 


productivity. 

Ansible is easy to deploy because it does not use any agents or custom security 
infrastructure on the client-side, and by pushing modules to the clients. These 
- modules are executed locally on the client side, and the output is pushed back to the 


sau 


sophisticated softwere, it is 


| difficult to trensfer all the e 
| knowledce required. Ansible server. 
EER a Features: 
DevOps TOOLS on 
o Itis easy to use to open source deploy applications. 


e Poppet Chef, Ansible end SaltStack are some most popular tools. aie: i 
It helps in avoiding complexity in the software development process. 


o- Iteliminates repetitive tasks. 
It manages complex deployments and speeds up the development process. 


3. Docker: 

e Docker is a high-end DevOps tool that allows building, shipping, and running 
distributed applications on multiple systems. It also helps to gather the apps quickly 
from the components, and it is typically suitable for container management. 


Features: 
It configures the system more comfortable and faster. 


o Itincreases productivity. 
o It provides containers that are use 
environment. 


d to run the application in an isolated 
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n available nodes to an active 


o Itroutes the incoming request for published ports 0 
f there is no task running on 


container. This feature enables the connection even 1 


the node. 


o Itallows saving secrets in the group itself. 


. Nagios: . 
Nagios is one of the more useful tools for DevOps. It ca 
rectify them with the help of network, infrastructure, server, 


n determine the errors and 
and log monitoring 


systems. 


Features: 
o Itprovides complete monitoring of desktop and server operating systems. 


o The network analyzer helps to identify bottlenecks and optimize bandwidth 
utilization. 

o It helps to monitor components such as services, 
- protocol. 
o Italso provides complete monitoring of Java Management Extensions. 
CHEF: . 
A CHEF is a useful tool for achieving scale, speed, and consistency. The CHEF is a 
cloud-based system and open source technology. This technology uses Ruby encoding 
to develop essential building blocks such as recipes and cookbooks. The CHEF is used 


applications, OS, and network 


in infrastructure automation and helps in reducing manual and repetitive tasks for 


infrastructure management. ae 7 ; 

Chef has got its convention for- different building blocks, which are required to 

manage and automate infrastructure. ; i 

Features: 

o Itmaintains high availability. 

o Itcan manage multiple cloud environments. 

o Ituses the popular Ruby language to create a domain-specific language. 

o The chef does not make any assumptions about the current status of the node. It 
uses its mechanism to get the current state of the machine. . 


. Jenkins: 


Jenkins is a DevOps tool for monitoring the execution of repeated tasks. Jenkins is 


software that allows continuous integration. Jenkins will be installed on a server ` 
where the central build will take place. It helps to integrate project changes more ` 


efficiently by finding the issues quickly. 

Features: 

o Jenkins increases the scale of automation. 

o Itcan be easily set up and configured via a web interface. 


| 
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o It can distribute the tasks i 
across mul i 7 
‚concurrency. tiple machines, thereby increasing 


o Itsupports continuous integration and continuous delivery. 

o Itof feri 400 plugins to support the building and testing of any project virtually 

o ` It requires little maintenance and has a built-in GUI tool for easy updates i 
Git: i l 

Git is an open-source distributed version control system that is freely available for 
everyone. It is designed to handle minor to major projects with speed and efficiency 
It is developed to coordinate the work among programmers. The version control 
allows you to track and work together with your team members in the same 
workspace. It is used as a critical distributed version-control for the DevOps tool. 


` Features: 


o- Itisa free open source tool. 
It allows distributed development. 
It supports the pull request. 


oó O 


It enables a faster release cycle. 

o Gitis very scalable. 

o -Itis very secure and completes tasks very fast. 

Splunk: 5 l 

Splunk is a tool to make machine data usable, accessible, and valuable to everyone. It 
delivers operational intelligence to DevOps teams. It helps companies to be more 
secure, productive, and competitive. 


Features: : 

o Ithasanext-generation monitoring and analytics solution. 

o Itdelivers a single, unified view of different IT services. 

o Extend the Splunk platform with purpose-built solutions for security. 


e Data drive analytics with actionable insight. 
Stackify: 


` Stackify is a lightweight DevOps tool. It shows real-time error queries, logs, and more 


directly into the workstation. It is an ideal solution for intelligent orchestration for 
Stackify Retrace allows teams to quickly identify 
and resolve issues, ensuring that the application is always available and performing 
as expected. 

Features: 

o Iteliminates messy configuration or data changes. 

o Itcan trace detail of all types of web requests. 

o Itallows us to find and fix the bugs before production. 
o It provides secure access and configures image caches. 
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o Itsecures multi-tenancy with granular role-based access control. 
o Flexible image management with a private registry to store and manage images, 


10. Selenium: 


Selenium is a portable software testing framework for web applications. It provides 
an easy interface for developing automated tests. 
Features: 


is) 


It is a free open source tool. 

o Itsupports multiplatform for testing, such as Android and iOS. 

o Itiseasy to build a keyword-driven framework for a WebDriver. 

It creates robust browser-based regression automation suites and tests. 


CONFIGURATION MANAGEMENT 


19) 


DevOps configuration is the evolution and automation of the systems administration 
role, bringing automation to infrastructure management and deployment. DevOps 


configuration also brings system administration responsibility under the umbrella of 
software engineering. ! 
Configuration management is a systems engineering process for establishing 
consistency of a product's attributes throughout its life. In the technology world, 
configuration management is an IT management process that tracks individual 
configuration items of an IT system. 

Software configuration management is a system engineering process that tracks and 
monitors changes to software systems configuration metadata. Configuration 
management is a key part of a DevOps lifecycle. DevOps configuration is the 
evolution and automation of the systems administration role, bringing automation to 
infrastructure management and deployment. 

Configuration management is important because it enables the ability to scale 
infrastructure and software systems without having to correspondingly scale 
administrative staff to manage those systems. This can make it possible to scale 
where it previously wasn’t feasible to do so. 


Configuration management in DevOps can help developers make changes to their 


systems quickly and efficiently while ensuring nothing breaks. It can also help keep 


track of any updates and changes along with the incident that triggered the change. 


In a properly managed DevOps configuration management, there are two prominent 
outcomes: 


o Infrastructure as code. 
o Configuration as code. 
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Delivering Infrastructure as Code; 


infrastructure as code (lac) in DevOps 


configuration management means managi 
nagin 
and provisioning infrastructure through code rather than manually AREARE it 


a ce or command-line interface. This approach allows for 
vers AA 

ie on controlled, tested, and automated, just like application 
This method makes it possible to manage infrastructure the same way you would an 
aa and makes it easier to deploy things consistently, go back to earlier 
versions if needed, and keep track of what's happening with the infrastructure in a 


transparent and traceable way. Some popular tools used for IaC include Ansible 
CHEF, Puppet, and Terraform. 


Example: Assume you wish to build a web application on a cloud provider such as 
AWS. eee orai: you would have to establish a virtual server manually, install the 
operating system, configure the network settings, and install the application-specific ` 
software. 

With Infrastructure as Code, you would write a script that outlines the infrastructure 
required to execute your application. This script will tell you what kind of server you 
need, how much memory it should have, and what software needs to be installed. 
After you've built the script, you can use a tool like Terraform to create the server, 
configure it, and install the required software with a single command. This way, you 
can consistently create a reproducible infrastructure and easily manage it in the 
future. 

Delivering Configuration as Code: 

Delivering configuration as code (CaC) is 2 way to manage and set up your system and 
apps using code instead of manual adjustments. This makes it possible to keep track 
of changes, test them, and automate the process just like your app’s code. This 
method lets you manage settings the same way as the app, making it easier to deploy 
or roll back changes quickly, see what settings are being used, and ensure everything 
is running correctly. 

Example: Using a tool like Ansible to configure a web server is an example of 
presenting configuration as code. Conversely, you can use an Ansible script instead of 
manually setting up the web server. This script will automatically configure the 
webserver to run the correct software version, set up the number of worker processes, 
and specify its root directory - essentially creating a recipe for setting up the web 


server that can be saved, reviewed, and tested before running. 


CONTINUOUS INTEGRATION AND DEPLOYMENT 


In this method you continuously build, test. and deploy iterative code changes. This is 
an iterative process. New code can be developed based on correct previous versions. 
So less human intervention new code can be designed and developed. 


‘ 
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e There are three primary approaches to this method. 

1. Continuous Integration: Consider an application that has its code stored in a Git 
repository in GitLab. Developers push code changes every day, multiple times a Frea 
day. For every push to the repository, you can create a set of scripts to build and digital Fei ine ee systems like routers, automation controls, televisions 
test your application automatically. These scripts help decrease the chances that Pai : pre a video game consoles, smartwatches, etc. The biggest suetess 
you introduce errors in your application. This practice is known as Continuous SA EAE REESE system) it is based on the Linux kernel that is running 
Integration. Each change submitted to an application, even to development panera O te - Due to Android, Linux has the largest installed base of all 
branches, is built and tested automatically and continuously. These tests ensure distribution: & systems. Linux is generally packaged in a Linux 
the changes pass all tests, guidelines, and code compliance standards you Architecture of Linu 
established for your application. GitLab itself is an example of a project that uses 
Continuous Integration as a software development method. For every push to the 


project, a set of checks run against the code. 
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e Initially, Linux 
sie r: Ae saat for personal computers and gradually it was used in other 
mainframe computers, supercomputers, etc. Nowadays, Linux 
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Fig. 1.4: Continuous Integration Method 
2. Continuous Delivery: Continuous Delivery is a step beyond Continuous 
Integration. Not only is your application built and tested each time a code change | ; 
is pushed to the codebase, the application is also deployed continuously. However, . Components of Architecture: 
with continuous delivery, you trigger the deployments manually. Continuous 1. Kernel: Kernel is the core of the Linux-based operating system. It virtualizes the 
Delivery checks the code automatically, but it requires human intervention to common hardware resources of the computer to provide each process with its 
manually and strategically trigger the deployment of the changes. virtual resources. This makes the process seem as if it is the sole process running 
3. Continuous Deployment: Continuous Deployment is another step beyond on the machine. The kernel is also responsible for preventing E 
Continuous Integration, similar to Continuous Delivery. The difference is that — conflicts between different processes. Different types of the kernel are: 
instead of deploying your application manually, you set it to be deployed | e Monolithic Kernel 
automatically. Human intervention is not required. e Hybrid Kernels ° 


LINUX OS INTRODUCTION : i Exo Kernels 
; i i e Microkernels ; 
special types of functions that are used to implement the 


e Linux is a community of open-source Unix-like operating systems that are based on ; 2. System Library: The 
the Linux Kernel. It was initially released by Linus Torvalds on September 17, 1991. It | functionality of the operating system. a lexity of the kernel’s 
is a free and open-source operating system, ifi ‘Iti i to the kernel which ay eee 
p p g sy and the source code can be modified and 3. Shell: It is an interface nds from the user and executes the 


distributed to anyone commercially or non-commercially under the GNU General functions from the users. It takes comma 
Public License. kernel’s functions. 


Fig. 1.5: Architecture of Linux 
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4. Hardware Layer: This layer consists of all peripheral devices like RAM/HDD/CPy 
etc. 


5. System Utility: It provides the functionalities of an operating system to the user, q 
IMPORTANCE OF LINUX DevOps 


Linux and DevOps share similar philosophies and perspectives as poth focus on 
customization and scalability. Linux has a customization aspect which is one core 
thinking in DevOps. It allows for design and security applications specific to a 
particular development environment or development goals to be created. There is 


much more freedom over how the operating system functions compared to Windows. A. 
Mostly Software delivery pipelines use Linux-based servers. If the DevOps team is 


using a Linux-based, operating system they can do all testing in-house and with 
extreme ease. i 


e The basic important point of using Linux is, the Linux Kernel can process huge 


amounts of memory and Linux-based systems are highly scalable. If the hard drive or 
other hardware requirements change during the development process these 
requirements can be added without losing processing power ‘in Linux. The same 
cannot always be said of the Windows operating system. 


Linux is important in DevOps because it is a powerful and flexible operating system 
that provides a wide range of tools and utilities that are useful for building and 
managing software applications. DevOps teams use Linux for tasks such as managing 


servers, configuring network settings, deploying and monitoring applications, and. 


automating tasks through scripting. ; 
Best Linux distributions for DevOps: re 


4. Ubuntu: Ubuntu is the most widely used Linux distribution in the world. There is 

a wide array of free, open-sourced, software tools available to Linux based DevOps 
practitioners. Those that are not free will be.only a fraction of the price of similar 
software available on the Windows platform. : 
Because of Ubuntu’s large distribution, it has very strong community support and 
also offers the option of commercial support should one desire it. 


2. CentOs: The CentOs is a notable mention simply because of the way it works with 
Red Hat Enterprise Linux (RHEL). RHEL is a popular Linux distribution that is 
widely used for applications such as microservers, cloud computing, application 
development, storage solutions, and many more. l : 

3: 


Fedora: Fedora is another option for RHEL cantered developers. It differs from 


CentOS in ma very important ways. For starters, Fedora is not an RHEL clone like © 
CentOS. It is officially adopted by the RHEL team since Red Hat uses Fedora as a 


sort of proving or testing ground for upcoming RHEL technologies. Because of this } 


Fedora is fully integrated with RHEL, 
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; cd: Change the current working directory. cd [directory] 


rmdir: Remove an empty directory. 


less : Display the contents of a file one page | less [options] file : 
at atime. l i ; 


G 
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4. ee eae OS: Build off the Linux distribution Cloud Linux is an operating 
3 a a specifically for cloud computing and shared hosting providers. 

or À ose who do not know Shared hosting refers to a type of web hosting where a 
single server is shared by several websites. Cloud Linux currently powers 


| somewhere in the range of 20 million web pages. Because it is based on CentOs, 
which in turn was heavily based on RHEL, one can fee 
and customization capabilities. 


1 confident in its scalability 


Debian: Debian is a -Linux distribution for servers. Debian is different from 
Ubuntu in what it prioritizes. For Debian, stability is more important than 
innovation and because of this, it lags behind Ubuntu when it comes to the 
integration of new software packages and libraries. With this in mind, it offers an 


enterprise solution for those who want to focus on overall stability- first and 
foremost. 


LINUX BASIC COMMAND UTILITIES 


Table 1.3 
Si a oe | 
ls [options] [directory] 


1. ls: List files and directories in a directory. 


pwd: Print the current working directory. [pwd S OSOS 
mkdir: Create a new directory. mkdir [options] directory 


rmdir [options] directory ; 
cp: Copy files or directories from one |cp [options] source file 
location to another. destination file 
7. mv : Move or rename files or directories. mv [options] 
| destination file 


as cat : Display the contents of a file. cat [options] file 


source file: 


head ;Display the first few lines ofa file. | head [options] file 
tail: Display the last few lines of a file. tail [options] file - 


grep : Search for a pattern in a file or | grep [options] pattern file 


find [path] [expression] 


tar [options] archive name 
| file(s)_to_archive 


contd. ... 
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å gzip : Compress files. 
gunzip : Uncompress files. gunzip [options] file.gz 
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gzip [options] file 


information about running | ps 


: Display 


ssh [user@]hostname 


17. ps 
processes. 

18. top : Display system resource usage and 
process information. : 


ssh ; Connect to a remote system using SSH. 


LINUX ADMINISTRATION 


The job of a Linux systems administrator is to manage the operations of a computer 
system like maintaining, enhancing, creating user accounts/reports, and taking 
backups using Linux tools and command-line interface tools. Most computing devices 
are powered by Linux because of its high stability, high security, and open-source 
environment. 


Linux DevOps is the practice of using Linux-based systems and tools to build, deploy, 
and manage applications in a Continuous Integration and Continuous Deployment 


environment. 

This approach allows for the automation of many common tasks associated with 

software development, including source control, build automation, infrastructure 

orchestration, deployment, monitoring, and logging. 

A Linux DevOps Manager should: 

1. Learn DevOps Tools: a Linux DevOps manager should learn DevOps tools like 
Docker, Ansible, Jenkins, Kubernetes, etc. These DevOps tools should be learned to 
become DevOps Manager in the Linux Operating system. To learn Linux DevOps 
tools, one should know the Linux command line and its various commands. This 
includes learning how to navigate the file system, how to create, remove and 
manage files, and how to install and configure software. It is also important to 
learn scripting languages such as Python, Bash, and Ruby, as these are commonly 
‘used in DevOps automation. Once a person is comfortable with the Linux 
command line and scripting languages, they can move on to learning about 
DevOps tools such as Ansible, Puppet, Chef, and Jenkins. 


2. Get Familiar with Infrastructure as Code(IaC): IaC is the process of managing 
and provisioning infrastructure through machine-readable definition files. 
Infrastructure as Code (IaC) is a method of managing and provisioning 
infrastructure and associated configuration through code, instead of manual 
processes. IaC is a key part of DevOps, as it enables organizations to manage their 
intrastructura i the same wey that they manage software, which is ra h 
Hep control and automation. To learn IaC, it is important sr es 
Sea of Infrastructure as a Service (las) and Platform as a Service 
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3. Automate Processes: DevOps practitioners should be comfortable with 


automating processes. This means scripting out manual processes, setting up 
ae Integration/Continuous Delivery (CI/CD) pipelines, and streamlining 
task execution. For this purpose, knowledge of scripting languages is important. 


4. Monitor and Optimize: Monitoring and Optimizing systems and processes are key 
components of the DevOps role. Monitoring helps identify problems, while 
optimization helps ensure processes run efficiently. Systems and process 
monitoring are essential aspects of the Linux DevOps role. DevOps engineers must 
be able to analyze system and process performance metrics, detect any potential 
issues, and take proactive steps to prevent outages or other negative impacts on 
system performance. They must also be able to identify opportunities for 
improvement and develop strategies for optimizing system performance. 


5. Collaborate: DevOps is all about collaboration between teams, and practitioners 


should be comfortable communicating with stakeholders and other teams. 
Collaboration is essential when transitioning to a Linux DevOps role. Working 
closely. with other team members can help build the skills and knowledge needed 
for a successful transition. 


ENVIRONMENT VARIABLES 


Environment variables are pairs of keys and values that can be used to customize the 
build process and store sensitive data such as access details to deployment servers. 
Linux is a multi-user operating system. Multi-user means that each user has own 
dedicated operating environment after logging in to the system. And this 
environment is defined by a set of variables, which are called environment variables. 
Users can modify their own environment variables to meet the requirements of the 
environment. ; 
1. Use command env or printenv to display currently defined environment 

variables, for example: 

$ env (or printenv) 

XDG_SESSION_ID=3@92 © 

HOS TNAME=xxxx 

NVM_CD_FLAGS= 

TERM=xterm-256color 

SHELL=/bin/bash 

HISTSIZE=1000 : 

SSH_CLIENT=xxxx 49967 22 

SSH_TTY=/dev/pts/@ 

l NVM_DIR=/mnt/efs/data/home/txu/.nvm 
USER=txu 
MAIL=/var/spool/mail/txu 


LC_CTYPE=en_US.UTF-8 
LESSOPEN=||/usr/bin/lesspipe.sh %s 


m 


> 
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2. echo command: To display a specific ENV v 
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ariable. 


$ echo $HOME 

/mnt/data/home/abc 

Set/Unset New Env variable 

export command: To set a new environment variable. 
$ echo $VERSION 

$ export VERSION=1.0.0 

$ echo $VERSION 

1.0.0 

unset command: To dele 
$ echo $VERSION 

1.0.0 

$ unset VERSION 


$ echo $VERSION 
You tan set/unset multiple variables as well. 


$ export VERSION=1.0.0 VERSION2=2.0.0 
$ unset VERSION VERSION2 


te/remove an existing environment variable. 


Set Persistent ENV Variables: 
1. For All users: To make ENV variables persistent for all users, you can leverage 


e. This file is used to set system-wide environmental variables on 


/etc/profile fil 
user’s shells. The variables are sometimes the same ones that are in the 


.bash_profile, however-this file is used to set an initial PATH or PS1 for all shell 
users of the system. For example: i i 

export CLASSPATH=./JAVA_HOME/lib:$JAVA_HOME/jre/lib 

After the addition is complete, the new environment variable will not take effect 
immediately, you need to run source /etc/profile to take effect immediately, and 
otherwise it will only take effect when you re-login as the user next time. 

For Single User: Setting specific ENV variables for single user, you can modify the 
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To add a directory path to PATH, you can write: 
$ pwd ; 
/root/docker/httpd 
$ export PATH=$PATH: $PWD 
$ echo $PATH 
/usr/local/sbin:/usr/local/bin: /usr/sbin:/usr/bin:/root/bin:/root/docker 
/httpd 
2. HOME: The user’s main working directory is the default directory when the user 
logs in to the Linux system. 
$ whoami 
tony 
$ echo $HOME -> 
/home/modern $ 
3. HISTSIZE: Save the number of historical commands. The commands we input will 
be saved by the system, and this environment variable records the number of 
commands to be kept. Generally 1000. 
$ echo $HISTSIZE . 
1000 ; i 
$ HISTSIZE=1001 
$ echo $HISTSIZE 
19001 


4. LOGNAME: Current user login name. 


$- echo $LOGNAME ' 
Modern. 
5. HOSTNAME: Host name.: 
$ echo-$HOSTNAME 
~ cloud-dev.modern.com 
6. SHELL: The type of shell use 
$ echo $SHELL 


d by the current user. 


.bash_profile file in the user home directory, which is a hidden file that can be + 
i : /bin/bash 
viewed by ll -a: Pata, 7 i 
$ cd ~ | NETWORKING - 

$ 11 -a .bash_profile . a Linux Networking and Troubleshooting Commands: i F 

-rw-r--r-- 1 tony tony 193 Sep 22 2021 .bash_profile 1. hostname: hostname command is used to view the hostname of the machine and to 
Common ENV Variables: set the hostname. 

: . com 
1. PATH: The paths, separated by colons, are a list of directories where executable Example: sudo eee fears “hostname” command when you restart the 
rograms e If you set the hostnam pine 

ae Bape sone: Hee the hostname will change to the name specified in the hostname file ( 


e.g. /etc/hostname). 


$ echo $PATH 
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin 


\ 


Gi) For RHEL, CentOS and Fedora you can change it in thes 
Jetc/sysconfig/network file. n 
ZŁ Host: Host command is for the reverse lookup of IP or a DNS nam 
Example: ) 
. If you want to find a DNS attached with an IP, you can use the host commands asl 
follovrs 


w 


, curl: Curi utility is primarily used to transfer data from or to a server. However, you 4 


A wget: The wget command is primarily used to fetch 


Introduction to 
you can use the /etc/hosts 


-Sem 13 


z HCA 

So if you want to change the hostname permanently, 

file or relevant hostname file present on the server. z 
ange íti etc/hostname 

@ For Ubuntu machines, you can change it in the / 


fost 8.8.8.2 g 
e You can also do the reverse to find the IP address associated with the domain | 
name. For example, l 
host ćevopscube.cos a 
ping: The ping networking utility is used to check if the remote server is reachable or 
not It fs primarily used for checking the connectivity and troubleshooting the i 
network. It provides the following details. i 
(i) Bytes sent and received 
(ii) Packets sent, received, and lost 
(iii) Approximate round-trip time (in milliseconds) 
Syntax: ping<IP or DNS» 
Example: ping cevopscube.con 
To ping IP address: ping 2.2.2.2 a 
* If you want to limit the ping output without using ctrl + c, then you can use the “- — 
c” flag with a number as shown below: 
ping -c 1 devopscube.con 


can use it for network troubleshooting. For network troubleshooting, curl supports. 
protocols such as DICT, FILE, FIP, FIPS, GOPHER, HTTP, HTTPS, IMAP, IMAPS, LDAP, - 
LDAPS, MOTT, POP3, POP3S, RTMP, RTMPS, RTSP, SCP, SFTP, SMB, SMES, SMTP, SIATPS, í 
TELNET and TFTP. 
For example, curl can check connectivity on port 22 using telnet. 
curl -v telnet://192.162.23,18:22 
* To check the FIP connectivity using Curl- 
curl ftp://ftptest.net 
© Youcan troubleshoot web server connectivity as well. 
curl hittp://devopscube.com -I 


web : i 
troubleshoot network issues as well pages. You can use wget to | 


7. 


-MCA -Sem fi 127 aos oa 


For example, you can troubleshoot proxy server connections using WZ 

wget -€ Use_proxysyes http _proxys<proxy_host:port> http: //exrtewelsite com 
« Youn check ifa website is up by fetching the files. 

wget www.google.com 
ip(config): ip command is used to display and menipulete routes and network 
interfaces. ip command is the nener version of ifconfig iftorfig works in 2 the 
systems, but it is better to use the ip command instead of ifconfig. 

ip addr 
This command can use with pipes and grep to get more gamir orp like the P 
address of the ethO interface. 

ip a | grep etha | grep “inet” lac “print $27 
e Get details of a specific interface 


ip a show ets 
¢ Bouting tables can be listed by following commands 
ip route 


ip route list 

arp: ABP (Address Resolution Protocol) shows the cache table of local nesworks’ IP 

addresses and MAC addresses that the system interacted wah 
arp Í 

ss{netstat): The ss command is a replacement for netstat You œn sT mse the 

netstat command on all systems. Using this command, you cen gat more 

information than netstat command ss command is fast becense i gets all the 
information from the kernel userspace. 

(a) Listening all connections: The “ss” command will Est 2l the TCP, UDP, anc Une 
socket connections on your machine. 

(b) Filtering out TCP, UDP and UNIX sockets: If you want to fiker out TCP, UD? oz 
UNIX socket details, use “-t” “-u” and “-x" flags with the “ss” command k wil 
show all the established connections to the specific ports. If you want to Est both 
connected and listening ports using “a” with the specific flag as showm below. 

ss-ta 
SS-u2 


$s-x2 Poia ERTER 

(c) List all listening ports: To list all the listening ports, use T g with zz 
command. To list specific TCP, UDP or UNIX socket, use -", “-u" and °-x" flag 
with “-]” as shovm below. 
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redhat@devopscube:~$ ss -lt 
State Recv-Q Send-Q Local Address:Port Peer Add 
LISTEN @ 128 *:ssh *:* 
LISTEN @ 50 :::http-alt :::* 
LISTEN @ 50 :::55857 :::* 
LISTEN @ 128 :::ssh :::* 
LISTEN @ 50 :::53285 :::* 
redhat@devopscube:~$ 
(d) List all established: To list all the established ports, use the state established flag as 
shown below. š 
ss -t -r state established 
To list all sockets in listening state, 
ss -t -r state listening 


ress:Port 


9. Traceroute: If you do not have a traceroute utility in your system or server, you can 


install it from the native repository. This is a network troubleshooting utility. Using 

traceroute, you can find the number of hops required for a particular packet to reach 

the destination. i i 
traceroute google.com 


10. mtr: The mtr utility is a network diagnostic tool to troubleshoot the network 


bottlenecks. It combines the functionality of both ping and traceroute. 
Example: The following command shows the traceroute output in real time. 
mtr google.com ; à 


11. dig: If you have any task related to DNS lookup, you can use the “dig” command to 


query the DNS name servers. - 
Get all DNS records with dig 


Example: The following command returns all the DNS records and TTL information 


ofa: 
twitter.com 
dig twiter.com ANY 


12. nc(netcat): The nc (netcat) command is known as the Swiss army of networking 


commands. 
Using nc, you can check the connectivity of a service running ona specific port. 


Example: To check if the ssh portis open, use the following command: 
nc -v -n 192.168.33.10 22 we 


13. telnet: The telnet command is used to troubleshoot the TCP connections on a port : 


Example: To check port connectivity using telnet, use the following command 
telnet 10.4.5.5 22 SAAN 


14. route: This command is used to get the details of the route table for 


Introduction to DevOps 


to manipulate it. your system and 


Examples: 
For listing all routes: 
Execute the “route” command without any arguments to list all the existing 
routes in your system or server. 
readhat@devopscube:~$ route 
Kernel IP routing table 
Destination Gateway Genmask Flags Metric Ref Use Iface 
default ip-172-31-16-1. 0.0.0.0 UG 00 0 etho 
172.17.0.0 * 255.255.0.0 U 0.0 0 dockerO 
172.31.16.0 * 255.255.240.0 U0 0 0 ethO 
ubuntu@devopscube:~$ 


e If you want to get the full output in numerical form without any hostname, you 
can use “-n” flag with the route command. 


redhat@devopscube:~$ route -n 
: Kernel IP routing table . 
Destination Gateway Genmask Flags Metric Ref Use Iface 
0.0.0.0 172.31.16.1 0.0.0.0 UG 0 0 0 ethO 
172.17.0.0 0.0.0.0 255.255.0.0 U0 00 dockerO 
* 172.31.16.0 0.0.0.0 255.255.240.0 U 0 0 0 eth0 
redhat@devopscube:~$ 
15. tcpdump: The tcpdump command is primarily used for troubleshooting network 
traffic. ss 
[Note: To analyze the output of tcpdump command requires some learning, so 
explaining it is out of the scope of this article.] 
tcpdump command works with the network ‘interfaces of the system. So you need to 
use administrative privileges to execute the command. 
e List all network interfaces: 
Use the following command to list all the interfaces. 
sudo tcpdump --list-interfaces 
e Capture Packets on Specific Interface: 
To get the dump of packets on a speci 


command. l 
Note: press ctrl + c to stop capturing the packets. 


fic interface, you can use the following 


sudo. tcpdump -i etho 


e To limit the packet capturing, 
tcpdump -i eth@ -c 10 


you can use the -c flag with the number. 


For example, sudo 
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i Ea all the interfaces, use any flag as shown below. | 1. To begin the installation, insert the installation media into your computer and set 
sudo tcpdump -i any ) the computer to boot from it. When the computer has booted from the media you 
16. Lsof: lsof is a command that would use in day-to-day Linux troubleshooting. This | will see the following language selection screen appear. 
command is equally important for anyone working with Linux systems. oe a a 
To list all open files, execute the lsof command. | : | Sa 
lsof ! | r z | 
One of the common errors faced by developers and DevOps engineers is “Bind failed — cn re 
error: Address already in use“. You can find the process ID associated with a port ` mina | Kies 7 
using the following command. Then you can kill the process to free up the port. : l , aua (eti 


jam 


t | 
f Erewa | rare 
lsof -i:8080 ; Cem 


Í ikt Iter 


120] i: | Se 
LINUX SERVER INSTALLATION Ae tot a | Eswal | van 


futtara | tao 
Installation of Ubuntu Linux Server 16.04 LTS (Long Term Support): 


Pers Lietseiipal 


Suoni Latvisal 


Requirements: 

e For this installation, you will need a copy of the Ubuntu Linux Server 16.04 
installation media. You can obtain the latest version as a DVD image (ISO) which can 
be used for this installation at www.ubuntu.com/download/server. Be sure to select | 
the Ubuntu Linux Server edition as the desktop version uses a graphical installer. 


‘Fig. 1.6 (i): Language Selection Screen 


Select the language you would like to use and press Enter. By default it is English. 


2. - Next you will be asked to select an action. 


: : : ; : : E- i e 
e We willbe installing the x86_64 DVD ISO image on a virtual machine. ubuntu 
Installer Keyboard Notes: q 
; a 
e The Ubuntu text installer utilizes keyboard keys for menu selections. The following is | Install Ubuntu Server 
a list of the primary keys you will use: T Instali WaS Region Controler 
{ Install MAAS Rack Controller 
o ‘Tab key or Arrow keys : Navigate from one selection to another { cheer die tor elect 
| l : Test nenory 
o Space Bar : Toggle selections on or off | Boot from first hard disk 
i ` R broken system 
o Enter key : Accept the current selections and proceed to the next step Some | aes 
keyboards may have a Return key rather than an Enter key) | 
Installation: 


Fl Help F2 Language F3Keymap F4 Modes FS Accessibility Fé Other Options 


The following steps will guide you through a basic installation of Uhani Linux Serve! 
16.04. The installation process will take some time to com 


akel plete and some steps will Fig. 1.6 (ii): Select an Action 

take longer than others. 

$ = rs Since we are installing Linux, we will choose the default Install Ubuntu Server by 
mportant: Kindl in ; 3 a 

ae y take backup before installation as this installation may erase the 1 


i pressing Enter key. 


a O 
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4. Once the system language has been selected you will be asked to select the 


3. Now that we 


rocess, the installer will ask for th = 
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during installation and operation, Here, we will select <No> t 
u i Pressing the Tab key will allo 


have begun the installation p 
you would like the system to use 
== p a + at a ray 


Í Daere the langust to be wed tor tre irttalletbon process. The cele ted Jorguage will 
f | slo te the etm pan tor te installed haiten, 


o allow us to manuall 
y select our keybo 
w ou to move between selections. yboard layout. 


i} 


language that 


You can try to have gor bm 


tot ert t3 63 Ins, yu RONI laput detected by pressing a caries of Legs. If you to | 


WILL De able ta seler? yor begrard lepit bros a Litt. | 


E lel 
Cetect tetera input? 


o locatizatimn 


ta baer) 


Fig. 1.6 (v): Detect the K board 
6. The first step in selectin ee 
e f g your keyboard’ i 
E mancer eyboard's layout is to choose the Country of 
oO Or Sst TE pest 


| 
| The Leput of tegowds sr Les cor camry 
a J OKTI tone Caer 4 
| layouts. Pieza peist the casara of origin for the tape gens ates mee 


Contre of origin tor the begat- 


Fig. 1.6 (iii): Select a language for the System 
We will be using the default, English. 


location the system will use. This setting is used for configuring the locality of 
several system services. . i : ; 


| The selected location sill te used ta Set your Time cone and also for exaecle to help 
| elect the nysten locale. Norwally this should be the country shere you live, 


| Tus ts a stortiist ct locations based œn the language you selected. Choose “other” if 
H er location is not listed. . 


| RE a a a 
T: ` Fig. 1.6 (vi): Select country for the keyboard 
‘We will choose English (US) which is the default. 
7; Next you willbe asked to select the specific layout within the Country of Origin of 


your keyboard. 


| a 
Ji Contry, teritoy o& yes: 


er phre pea | 


Please select the Leaut sate. 


cepo Iyot: 


ny the tepos (or a eae, 


Saa Africa 
Writes rinia 
Erguasn (us) ~ Carer E 
alim (us) > Delhin (Oi 
EM ISA (US) + ingis (ara aitereat ive internet omal ro am iea) 
Erghisn (u31) ~ Exxiish Norm! 
Erg lish (GS) - 
tration WS) = 
Eoghan (us) - 
grilis (03) > 
| engish (es) + 
English (Us) 

i j hisa (more ma 
Hotes Hen - tnetive cersaan, intereatiane] sith grad bee) 


edia 
qotecnational ait) wai tey 


Engram (e Lapaac tere) 


A x <= a =: | aS wal T giiir Uhh ioni A wat key) 
ee Fig. 1.6 (iv): Select Location ae = | aun OSN T EER Mites SS sae tne ine! 
ewill i : mie a 
she aes the default, United States by pressing Enter key. ; vie us) 
nstaller will now ask whether or not it should try to detect your keyboard | il 


> selects datera activates bultora 


layout. You can select <Yes> to allow 
| the system to d i 
is successful you will automatically skip a step 8. i aca a E 


If th ion i ; 
ae eee is not successful you will need to complete the manual selectio” Fig. 1.6 (vii 
steps 6 and7 as if you had selected <No». j We.will again choose Engli 


): Select Specific Keyboard Layout 
sh (US) which is the default. 
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$ ically configure your networ options. | 
8. Your system will now try to Ane the following failure message; rith i 


unable to do this you will be pre 


meali faim 
etgxriig l ké 
atoom ne AE protocol, Altern: atively, 
ret usi í w m hynteare 1s not working 


Ne Tet 


Your netoa js mecsbly 
the [ACF serves ray Me nw o 


art ivatec Kotane 


Tsk) mwar: (nares colectc: Entan — 
Fig. 1.6 (viii): Configure the network automatically 

To continue to the network configuration step press the Enter key. 

9. Toconfigure your network settings you will be presented with four options, - 


The first two options allow you to retry the auto-configuration process. These 


options are useful if you can correct the reason your network was not able to be | 


configured automatically and you wish to retry the automatic configuration. 


You can also choose to skip configuring the network by selecting Do not | 
configure the network at this time. If you choose to skip -configuring the f 


network, you will need to manually configure your network settings after 


installation completes before your system will be able to communicate with other |. 


servers on your network. 4 
For our example, we will select Configure network manually. 


i 

| 

| From here ou csn cheese to retry DHF network autoconf igurat'ion 
| (hich mey Deeg jf yor DHP server teres a long time to respond) 
| Or to cotiere the nmetwn eauallg. Som DHCP servers require a 

| DACP hostname to be sent by the client, so uou.can also choose to 

| rey DHO neter enoconiiguration elth a hostname that you 

| provide. 


Met configuration rhes: 


Petry retri actoconfigrazion 
Ferru retri atori Ipuration with â DHCP hostname 


Do rot coriigre the retort. at this tine 


ga Baky 


Fig. 1.6 (ix): Configure Network mai 
After you have made your selection press the Enter key to continue 
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10. Now that we have selected Congi 


1,45 
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The IP address {+ 
I 633 15 unian to your tometer ard muy be: 


. four finter, e 
VETS SPOar ated < TD: 
© DIGCES Gf hecader ima] a papas (Py); 


Sesarstes by colons (IP48). 


You e 4 ‘ 
an alse cpt lonaiby accend a crga nerra (nen as 724") 


Tf you don't erem WAT 15 us 


adninistrator, 2 here. consult yor retwory 


IP address: 


Fig. 1.6 (x): IP address 
In the provided field, enter the IP address of 1.2.3.4. When done, press the Tab key 
until you get to <Continue> and then press the Enter key. 
11. You will next be prompted to enter the network mask for your network. Again, if 
you do not know your network mask please consult your network administrator 


for the information. 
In our example, we will use the default 255.255.255.0 as our network mask. 


valve. 
pericds. 


Fig. 1.6 (xi): Network Mask 


default network mas 
Continue> and then press the 


k of 255.255.255.0 simply press 


Since we are accepting the Enter key. 


the Tab key until you get to< 
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twork gateway for our network, 


s of the ne iene 
er the IP addres formation to you if you do not 


trator can provide this in 


12. In this step, We will ent 
` your network adminis 


know whatit is. 
In our example, we 


dress. 
will use the address 1.2.3.1 as our gateway ad 
- T ipj contigure the reton 

seriods) that 

The gateway is an IP address (four nusbers separated ri epa Ma 
indicates the gateagy router, also anon as the geral al pres E 
traffic that goes outside your LAN (for instance. to the imere 
sent through this router. In rare cic eT ge no 
router; in that case, you can leave this blanks. hae 
the proper answer to this question, consult your ne 


gdministrator. 
Gatevoy: 
a Back? contine) 


selects: (Enter) activates Dut ONS 


(Taho noves: (Svare) 
Fig. 1.6 (xii): IP address of the Network Gateway 


In the provided field, enter th 
When done, press the Tab key until you get to < 


Enter key. 


13. In this step, we will enter the IP address of the primary name server for our 
network. Your network administrator can provide this information to you if you — 
do not know what it is. Here, we will use the address 8.8.8,8 as our name server | 


address. 


The name serwers ere used to look up host nares on the network. 
Please enter the IF edéresses (not host names) of up to 3 name 
servers, separated by spaces. Do not use commas. The first name 
server In the List will be the first to be queried. If you don’t want 
to use any name server, Just leeve this field blank. 


Kase server addresses: 


Fig. 1.6 (xiii): Name server Addresses 
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e IP address of 1.2.3.1 for the gateway ‘address, 
Continue> and then press the 
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In the field provided, enter the IP address of 8.8.8.8 for the name server address. 


When done, press th 3 
Enter key. P € Tab key until you get to <Continue> and then press the 


14. Next you will be asked to enter the name that this host will be known as. This 


name can be 

aie i Be word (no spaces) and should not contain special characters 
. mon, however, for system administrators to utilize a dash "-" 
in their host names. (Such as web-server-1) 


f 


Please enter the hostnare for this onte. 
The hostname 15 a siegle word tr 
s e word that identifies your sonte ta the netart. If | ont 
kron what your hostname should te, consult your refart adeinistrstor. H Brei eS 
your oun home neturi, you can make somthing up here, aes 
Hostname: 


«Go Back) —— 


: ; Fig. 1.6 (xiv): Hostname 
.When selecting your host's name, it is important to select a meaningful name to 


prevent:confusion with other hosts on your network. 
Since the host we are building-will not appear on a network, we will leave the host 


name as its default value of ubuntu. Press the Tab key until you get to <Continue> 
and then press the Enter. - : 


15..In this step, you will be asked to enter the full name of the primary user of the 


system. (Note: On Ubuntu systems, this user is NOT the root superuser but will 
have administrative capabilities.) 


ef the rest account for 


A user account will be created for you to use instead 
non-administrative activities. 


Please enter the real name of this user. This intormation will te used for instance as 
default origin for emails sent by this user 3s wll as amy progran wich displays or uses 


the user's real name. Your full name is a reasonadle cneice. 


Cont faam 


<Go Buch» 


narm saleciss <fnier> act ivat ee _bultons 


Fig. 1.6 (xv): Real name for the new user 


Tah» aanvat: ¿$i 
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On our system we will set this user name to TechOnTheNet put you a TeS to 
use your full name. Press the Tab key until you get to <Continue> an press 
the Enter key. 

16. Next, we will enter the user name that we will use to log in. This name should be 
lowercase and not include spaces or non-alphanumeric characters (Characters 
that are not numbers or alphabetic characters). 3 


i i hoice. The 
Select a username for the new account. Your first name is a reasonable c 
username should start with a lower-case letter, which can be followed by any combination 
of numbers and more lower-case letters. 


Username for your account: 


Fig. 1.6 (xvi): Username for the new account 
In our example, we will use techonthenet for our user account. Press the Tab key 
until you get to <Continue> and then press the Enter key: 


17. On this screen, we will need to enter the password you would like to use for the 
techonthenet user account. 


It is important to choose a strong password that cannot be easily guessed and that 
you'll remember! (Typically strong passwords are more than 8 characters long and 


contain upper/lower case characters and have numbers or special characters such 
asa "$",) 


A good passeord will contain ao 


Ixture of letters, numbers and punctuation and 
changed at regular intervals, Sgor = 


Choose a password for the new user: 
] ‘Show Passord in Crea : 


«Go Back> 


Cont ini 


Fig. 1.6 (xvii): Set up a Password 
After entering the Password, 


then press the Enter key, 


18. In this step, you will be asked to re- 
previous step. This is to ensure that the 


Press the Tab key until you get to <Continue> and 


. 


enter the password you used from the 
passwords match. 
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(11) Sat up 


Please enter the sare user pass 


users and pace ords 


word again to verify you have typed it correctly. 
Re-enter password ta verify: 


Show Password IMC IEA 


<Go Back) 


Fig. 1.6 (xviii): Reenter Password 
After re-entering the password, press the Tab k 
` then press the Enter key. 


19. If you entered a weak password, the installer will prompt you to confirm that you 


ey until you get to <Continue> and 


want to proceed 


or re-enter a stronger password. 


You entered a password that consists of less than eight characters, ehich is considered 
t00 weak. You should choose a stronger password, 


Use weak password? ` 


Go Bacio A : Ea av 


, Fig. 1.6 (xix): Confirmation for the password - 

` Since our machine will only be used for this tutorial, we will accept the risk and 

continue. If you choose <No> you will have to repeat the password selection 
(Steps 11 and 12). If you choose <Yes> you will proceed to the next step. 

20. Ubuntu allows you to encrypt your home directories for security. This is useful for 

situations where users require security on items they keep in their home 

directories. Here, we will select <No> and not encrypt the home directories. 


PANT =e -i 


[!] Set up users and passwords 


You may configure your home directory for encryption, such that any files stored there 
remain private even if your computer is stolen. 


The system will geanlessiy mount your encrypted hone ci fea PENMAN A ee 
automatically unmount when you log out of all active sessions, 


` 


es) 


Encrypt your home directory? 


<Go Back) 


Fig. 1.6 (xx): Confirmation to encrypt the home directories l 
al i d choose the time zone your computer 
: i ill configure the clock and choose 
a wie ae een time services will use this setting to display the correct local 
se. 


time. 


D 
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bact to the steg Theore language” 
I¢ the cesired tine cone is ret listed, then piesse po da a Le. 
ad velect 8c artry thet exes the cesired time cone (the country here you Live or are 
tecated). 


Select yor tim soe: 


Eastern 
Certrs) 


mantala 


Alaa 
Ramil 
ariza 
East melisma 
Sers 


Fig. 1.6 (x0d): Configure the clock 
On our system, we will select the Pacific Time zone. 


22. Ubuntu will now ask you to configure your hard disk partitions. There are 


several choices available: ; 


o Guided - use entire disk: Creates a non-LVM (Logical Volume Manager) 
partition layout which follows a more traditional UNIX layout. This scheme- 
creates fixed partitions which can not be easily changed without Te-am 


installation or advanced knowledge of Linux. 


o Guided - use entire disk and set up LVM: Allocates a small boot partition and 


places the remaining available disk space into a logical volume in which the 


other partitions will be created. LVM allows additional flexibility in how the > 


logical volume will be laid out or changed in the future. 


o Guided - use entire disk and set up encrypted LVM: Creates a similar l 
partition layout as the previous option but encrypts the logical volume with a 


password. ; 


o Manual: Allows manual configuration of disk partitions. This is an advanced 


mode typically used by experienced UNIX administrators and allows full 
control over the layout of the partitions. 


Here, we will choose the second option which is Guided - use entire disk and set 
up LVM. 


The installer can guise you through petitioni 
schemes) or, Lf you preter, 
STAI! hove a chance Lat 


ng a dist. (using different standard 
Yu Can co it manually. with guided partitioning you will 
E to revies and Custcalse the results. 


gou doce guised partitioning 
Id 


fi 
Seu 


bom. MG for en entire did, you will next be asked thich disk 
Partitioning yas: 


Guided - use entire die 
ait i one entire Otsi od wetu UN 


oes ~ USE entire cise enc cet up encores LU 
pars 


Fig. 1.6 (œi): Select Disk Partition Method 
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23. Next we will need to select the hard disk that we will apply the hard drive 
partitions to. Since our computer contains only one hard drive, we can accept the 


defaults and continue. If your system has more than one hard disk, you will need 
to select the appropriate hard drive your system is set to boot from. 


Note that all cata on the disk you select will te erased, but not before 


rs brave 
confirmed that you really cant to esre the charges. 


Select -disk to partition: 


CS133 (9.0.0) (243) $121.5 Co Weare” Were Virais 


Fig. 1.6 (odii): Select disk to Partition 

24. The installer will now confirm that you are prepared to write the partition layout 
` to the hard disk you have selected. 
| Pima. rl 


Before. the Logical Volume Manager can be configured, the osrent cartitioning scheme bes 
to be written to disk. These changes cannot be uncore. 


after the Logical Volute Manager is configured, ro additional cays ee = 
scheme of disks containing physical volumes are allmed aring t es le 
decide if you are satisfied with the current partitioning shew tetore continuing. 


The partition tables of the following devices are Carged: 
$CS133 (0,0,0) (sda) - 


krite the changes to disks and configure LWW? 


Fig. 1.6 (xiv): Save changes to disks and configure LVM. 


- If you are ready to apply your selected partition layout to the hard disk, tab to 


ress the Enter key. 
ee entering the amount of hard disk space you would like the 
Linux Server. The installer will by default fill in the 
your hard disk but you can lower this value to 
oses. Values are typically entered in MB 


25. In this step, you will be 
installer to use for Ubuntu 
total amount of space available-on 
leave some space available for other purp 


(megabytes), GB (gigabytes) or TB (terabytes). 
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. Next, the i i x 
28 installer will ask if you would like to configure automatic system 


or part of it. If you use 
11 be able to grou logical 
4 the volume group at 


You may use the whole volur group for guided partitioning, 
| miy part of It, or If you add more disis later, then you wl 
| volumes Later using the LY tools, so using a smaller part O 

installation time aay offer more flexibility. 
Hy | Te minim size of the selected partitioning recipe 18 3.0 08 (or 143); please note that 

the packages you choose ta install may require pore space than this, The saxleum 

evalleble size is 21.0 @ 

Hint: “eax” can be uted as a shortcut to specify the amina size, on enter 8 percentage 
(e.g. “203") to use that percentage of the movies size. 


fount of volume group to use for guided partitioning: 


Fig. 1.6 (xxv): Amount of volume group to use for guided partitioning 
We will leave the value unchanged which will tell the installer to utilize all 


available hard disk space. Press the Tab key until you get to <Continue> and then 
press the Enter key. . 

26. The installer will confirm that you are 
the hard disk. 


p- Part ier TTY : z : = 
Lf you continue, the changes listed below will be eritten to the disks. Otherwise, you | 


will be able to mae further changes msrually. 


ready to write the partition information to 


The partition tables of the following devices are changed: 
LUM VG ubuntu-vg, LV root rs 
LV4 VG Ubuntu-vg, LV sano! 

SCS133 (0.0,0) (sda) 


The following partitions ere going to be fermatted: 
LW VG Ubuntu-ve, LY root as ext4 
LW VG uhuntu-wg, LV saao_i as swan 
partition #1 of SCSI33 (0,0,0) (sda) 55 ext2 


krite the changes to disks? 
[ven] wo ,. 


; ; Fig. 1.6 (xxvi): Save changes to disks 
Since these settings are correct and we are. ready to wri 
information we will select <Yes> to continue. ; 

27. If you utilize a HTTP proxy on your network, you can e 
on this screen. i 


nter the proxy information 


If you need to use a HTTP prozy to access the outside world, enter the proxy inf 
here, Otherwise, leave this blank. setae 


The proxy information should be given In the standard form of 
Nttp://(luser) (:pass)@) host [:port)/", 


HTTP proxy information (bland for none): 


(Go Bact» 


i Fig. 1.6 (xxvii): HTTP Proxy Information Pam 
We will not provide any HTTP proxy information so we press the Tab key until we 
get to <Continue> and then press the Enter key. i 


29, At this step, 


ite the partition. 


updates. The options available are: 
N : : 

o Shae Gada ae No updates will be applied automatically by the 
PPA ites Pdates will require manual intervention by a system 
Install security updates automati i i 
Install s ] atically: Updates which resolve securi 
issues will be applied automatically once per day. ij 
Manage system with Landscape: System updates will be managed externally 
by the Landscape application suite. ` 


1) tiari tassel 


Applying updates on a frequent basis ‘ls an Important part of reeolrg your system secure. 


By default, updates need to be applied eanually using package nanagenent tools. 
A}ternatively, you can choose to have this systea autcratically download and Install 
security updates, or you can choose to manage this system over the wb as part of a grou 
of systems using Canonical’s Landscape service. 


How do you want to manage upgrades on this system 


No autozatic sess 
[nstallesecur i tycindstesrentomat ical! 


Manage systen with Landscape 


Fig. 1.6 (xxviii): Options to manage upgrades on the system ` . 
ecurity updates are applied in a timely manner 


It is always a good idea to ensure s 
so we will select Install security updates automatically option. 

[TIP: If you are concerned that an automatic update might break other software 
or services the host offers you may want to select No automatic updates and 
apply the updates manually when required.] 

we will be asked to select any additional so 
he host. By default the standard sys 
tains many of the system utilities 


ill leave it selected. - 


ftware or services we 


tem utilities option is 


would like to install on t that we will need to 


‘selected. This option con 
manage our system so we W 


momen tes to your 
t te systea is Installed. To tune the Si 

re i jou ah only greta one 5 more of the followlnd predefined collections of 
needs, yi 


software. 


Choose software t0 Install: 


rvice to install on the host 


52 -<50a0e selects: «Ent 


ditional software/se 


Fig. 1.6 (xxix): Select the ad 
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Since we would like to be able to log into the host using secure shell (SSH) from 
another host on the network we will also select OpenSSH server. 


You can select a menu option by pressing the Space Bar. Moving between menų 
items can be accomplished by using your keyboard's Arrow keys. 
When you are finished selecting the software, select <Continue>. 

30. The system will now ask to install the GRUB boot loader onto the master boot 


record of your hard disk. GRUB is used during the boot up process to enable 


Ubuntu Linux Server to load. 


It Seems that this new installation Is the only operating system on this computer. If so, 
1t should be safe to install the GELS boot loader to the master boot record of your first 
hard crive. 


Warning: If the installer falled to detect another operating system that {s present on 
your Computer, modifying the masten boot record will make that operating system 
temporer ily bootable, though GRUB can be manually configured later to boot It. 
Install the GRUB boot loader to the master boot record? 


Co Back 


Gs ao 


Fig. 1.6 (xxx): Install the GRUB boot loader 
We will select <Yes> to install the GRUB boot loader. 


31. Now the installation is complete. The installer will now 
computer. 


erates : : Installation comlete 
3 $ Complete, so it is time to boot into your new sus 
the installation media (CO-POM, floppies), so that i ner 


tem, Hake sure to remove 
than restarting the Installation, 


you boot into the new system rather | 
(Go Baci) 


tiant {nies 


Mabi moves: Spacey selects: <Enter> activates buttons 


l Fig. 1.6 ood): Finish the Installation 
Select <Continue> to reboot into Ubuntu Linux Server 


prompt you to reboot the l 
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32. If all goes well in a few minutes, 


ou ; ; 
following screenshot; you will see a login prompt similar to the 


Fig. 1.6 (xxxii): Log-in Screen 
You have successfully installed Ubuntu Server Linux. Now you can log in using 


the user name and Password you configured during Steps 10, 11and 12. l 
RPM AND YUM INSTALLATION = e west Da 


YUM (Yellowdog Updater Modified) is an open-source and free command-line package 


management utility for systems executing the Linux OS with the help of the RPM 


package manager. Many other tools offer GUI to YUM functionality because YUM 
contains a command-line interface. 


YUM permits automatic updates and package dependency management over RPM- 
based distros. YUM implements software repositories (set of packages) that can be 


locally used or on a network connection similar to the Advanced Package Tool from 
Debian. 


Installing YUM in Ubuntu: 
Step1: Update the System 


We need to execute the update command for getting the latest package information and 


updating package repositories: 


¢ sudo apt update 


New@ubuntus~§ sudo apt update 
[sudo] password for krishu: 
Hit:1 http://ppa.launchpad.net/gezakovacs/ppa/ubuntu focal Inkelease 
Hit:2 http://in.archive.ubuntu.con/ubuntu focal InRelease 

Hit:3 https//in.archtve.ubuntu.com/ubuntu focal-updates InRelease 

Hits4 hittp://Un.archive.ubuntu.com/ubuntu focal-backports InRelease 
Get:5 http://securtty.ubuntu.con/ubuntu focal-securtty InRelease (114 R3} 
Get:6 http://security.ubuntu.con/ubuntu focal-security/main 1386 Packages (441 k 
B 

“ae http://security.ubuntu.con/ubuntu focal-security/maln andés Packages 
Get:8 http://securtty.ubuntu.com/ubuntu focal-security/matn Translatton-en (257 
kB]. 

a http: //security.ubuntu.com/ubuntu focal-security/main andé4 OEP-11 Metadat 
‘a ` 


Get:10 http: //security.uduntu.com/ubuntu focal-security/naln andó3 c-n-f Retadat 
a [10.4 kB] 


Ign:11 http: //securtty.uduntu.con/ubuntu focal-securtty/restricted and64 Package 
‘ : 


Geti12:-http://security.ubuntu.com/ubuntu focal-security/restricted Translation-e 
n [135 kB) 

. (386 Packages 
Ton:13 http: //security.ubuntu.com/ubuntu focal securlty/universe 
cn Maa A security -ubuntu.con/ubuntu focal-security/untverse and64 Packages 
[705 kB] i 
Tan:15 http: //security.ub 


untu.con/ubuntu focal-security/universe Translatton-en 


Fig. 1.7 (a) 
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3. Which of the following is not a feature of continuous delivery ? 


Introduction to Devo : 


Step2: Install YUM ; ` i 
We need to execute the install command for quickly installing the packages and their 


dependencies: 


$ sudo apt-get install yum 


ubuntu@ubuntu-VirtualBox:~§ sudo apt-get install yum 
[sudo] password for ubuntu: 
Reading package lists... Done 
Building dependency tree 

Reading state information... Done 


Fig. 1.7 (b) 


Summary | 


This chapter gives an idea about DevOps and its operations. 

DevOps (a combination of two words such as “development” and “operations”) is 
the combination of practices and tools designed to increase an organization's 
ability to deliver applications and services faster than traditional software 
development processes, 

DevOps is used to increase an organization’s speed at time of delivering 
applications and services. Many companies ‘have successfully implemented 
DevOps to enhance their user experience including Amazon, Netflix, etc. 
There are various terminologies used in DevOps such as Container, Commit, 
Agent, Deployment etc. 

DevOps is the grouping of cultural philosophies, practices, and tools that 
increases an organization's skill to deliver applications and services at high 
velocity: evolving and improving products at a faster pace than organizations 


using traditional software development and infrastructure management 
processes, i 


There are various tools like Puppet, Ansible used for m 
DevOps configuration 
administration role, bri 
deployment. 


This chapter also shows how to install Linux OS and use 


; ; anagement of DevOps. 
is the evolution and automation of the systems 


nging automation to infrastructure management and 


Check Your Understanding 


1. 


its basic commands. 


Identify the method that does 
methodology? 
(a) Waterfall Software Delivery (b) Lean Manufacturing 
(c) Continuous Software Delivery (d) Agil 

S i 
eee (d) Agile Software Delivery 


(a) Asmall team of people that own everythi 
in : : 
(b) Developers performing operations tything related to a particular service 


(c) Developers and Operations team memb 
(d) None of above 


least impact the. establishment of “DevOps 


ers working together 


(a) Automate Everything 

(c) Bug fixes and experiments 
4. What is the use of Git? 

(a) Version Control System tool 

(c) Containerization tool 


(b) Continuous Improvement 
(d) Gathering Requirement 


(b) Continuous Integration tool 
l (d) Continuous Monitoring tool 
5. What type of mindset is the core of a DevOps culture? _ 
(a) Service Mindset (b) Skill Mindset 
(c) People Mindset (d) Process Mindset 
6. Which statement does NOT define DevOps? 

(a) DevOps is a framework and job title that focuses on structured processes to 
organize flow between the Development and Operations teams. 

(b) DevOps is a movement or practice that emphasizes collaboration and 
communication of both software developers and other Information 
Technology (IT) professionals. 

(c) DevOps is about experiences, ideas, and culture. 

(d) DevOps is an activity of optimizing the development to operations value 

` stream by. creating an increasingly smooth, fast flow of application changes 
from development into operations. 

7. What is- the difference between Continuous Delivery and Continuous 

Deployment? aa ie 

(a) Continuous delivery is a manual task, while continuous deployment is an 
automated task. A , 

(b) Continuous delivery has a manuäl release to production decision, while 
continuous deployment has releases automatically pushed to pradueton: 

(c) Continuous delivery includes all steps of software development life cycle; 
continuous deployment may skip few steps such as validation/and testing. 

(d) Continuous delivery means complete delivery of the application to customer; 
continuous deployment includes only deployment of the application in 

i ent 
8. ee merge commit every, time you need to pacar pBrAle 
changes. 

(a) Git Merge 

(c) Git Fork 

9. Howwill you find all the changes th 

(a) git diff-tree-a <commit id> 

(c) git diff-tree-r <commit id> 


(b) Git Push 
(d) Git Fetch 

at were made in a certain commit? 
-(b) git diff-tree-d <commit id> 
(d) git diff-tree -s <commit id> 


Answers 
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Practice Questions 


Q.I Answer the following questions in short. 
What is DevOps? 
How Lean Model is better than SDLC? 
State various processes used to implement Agile. 
What is ITIL? 
What are various phases of DevOps lifecycle? 
Who are DevOps Stakeholders? 
State any two goals of DevOps 
What is BDD? 
What is Continuous Delivery? 
. What is MTBF? 
. What is MTTR? 
. What is Database Versioning? 
. State the best practices for version control for DevOps? 
. What is Kernel? 
. What are environment variables? 
16. What is YUM? 
QII Answer the following questions. 
What are various processes used to implement Agile? 
Explain various phases of DevOps Life cycle? 
What are best practices to follows when using DevOps? 
What are various advantages and disadvantages of DevOps? 
What are various goals of DevOps? 
Explain DevOps perspective of Infrastructure Environment? 
What are key differences between DevOps and Agile? 
State some features of any one DevOps Tools you like? 
What is Configuration Management? 
. Write a short note on Configuration Management. 
11. What are three approaches of continuous integration and deployment? 
12. Explain architecture of Linux OS, a 
13. Explain any four basic commands in Linux. 
14. What are roles and responsibilities of Linux DevOps Manager? 
15. Explain any four Linux networki i 
TET EE aie ies king and troubleshooting commands. 
1. Continuous Integration and Continuous Delivery (CI/CD). 
DevOps Life Cycle. 
Architecture of Linux. 
Linux Networking Commands, 
Environment Variables. 
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_ Version Control - GIT 


Objectives... 


After learning this chapter you will be able to: 

Understand the concept of version control systems, GIT and its types. 
Understand the basics of GIT and its installations. 

Learn various commands of GIT. 

Understand repository creation using GIT with branching concept. 


m m) m) m) 


(2.1 | INTRODUCTION TO GIT use 


Version Control Systems (VCS) are used by all software developers during all phases 
of project development. These version control system helps them to manage software 
code and it helps them to keep the history of all versions of all software code, projects, 
and objects. In software engineering all the software developers must communicate’ 
with each other to get better outcome of it. Version control systems support version in 
collaborative framework so that all software engineers work efficiently. Without the 


use of VCS collaborations become challenging. The aim of this chapter is to give idea 


about version control system with Git, its history, installation and branching concept. 
Before version control systems software developers did not have an efficient way to 
collaborate on their code. Software developers had a hectic time while trying to work 
on the same code at the same time. They improvised by mailing each other code for 
sharing, they stored their code on USB sticks and physical floppy disks as backups, 
they made sure to work in small teams and work in different parts of a system it was 
manageable for small projects, but people needed large systems that could suit their 
needs. These challenges led to the need for a version control syetm where Seles’ 
could effectively collaborate on code and keep backups of various versions of a 


project. 
But before moving into GIT, W 
Control Systems (VCS) and Git. 


e should have a basic understanding about Version 


(2.1) 
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Git is a free and open-source Distributed Version Control System (DVCS) designed 
to handle everything from small to very large projects with speed and eff iciency 
(Global Information Tracker). 

GIT relies on the basis of distributed development of software where more than 
one developer may have access to the source code of a specific application and can 
modify changes to it that may be seen by other developers. 

GIT has the functionality, performance, security, and flexibility that most teams 
and individual developers need. 


e Initially designed and developed by Linus Torvalds for Linux kernel development 
in 2005. | 
Every GIT working directory is a full-fledged repository with complete history and 


full version tracking capabilities, independent of network access or a central 
server. 


the team cope up with the confusion that tends to happen when multiple people 
are editing the same files. 


ABOUT VERSION CONTROL SYSTEMS AN D TYPES 


Sey 


Version control is a system that records changes to a file or set of files over time so 


that you can recall specific versions later. For the examples in this chapter, you will 
use software source code as the files being version controlled, though in reality you 
can do this with nearly any type of file on a computer. F. 
If you are a graphic or web designer and want to keep every version of an image or 
layout (which you would most certainly want to), a Version Control System (VCS) is a 
very wise thing to use. It allows you to revert selected files back to a previous state, 
revert the entire project back to a previous state, compare changes over time, see who 
last modified something that might be causing a problem, who introduced an issue 


and when, and more. Using a VCS also generally means that if you screw things up or . 


lose files, you can easily recover. In addition, you get all this for very little overhead. 


Version control systems are a type of software tool that helps in recording changes 
made to files by keeping track of modifications made to the code. When we develop a 
software product, most of the time we collaborate as a group. So, the thing is these 
groups of software developers might be located at different locations and each one of 
them contributes to some specific kind of functionality or features. So, to contribute 
to the product, they made modifications to the source code. So, this version control. 
system helps developers to efficiently communicate and 
changes that have been made to the source code alon 
made and what change has been made. 


manage (track) all the 
g with the information like who 


GIT allows a team of people to work together, all using the same files. And it helps 


Ops : MCA [Management - Sem. | 
Dov? 2.3 Version Control - GIT 


Local Version Control Systems; 


e Many people's version-control method of choice 


(perhaps a time-stamped directory, if the 
because it is so simple, 


is to copy files into another directory 
y're clever). This approach is very common 
but it is also incredibly error prone. It is easy to forget which 


directory you're in and accidentally write to the wrong file or copy over files you 
don’t mean to. 


To deal with this issue, programmers long ago developed local VCSs that had a simple 
database that kept all the changes to files under revision control. 


Version Database 


Fig. 2.1: Local Version Control Systems 
e One of the most popular VCS tools was a system called RCS Revision Control System) 
: (manages multiple revisions of files), which is still distrite with many epmpaters 

today. RCS works by keeping patch sets (that is, the differences between Hie) ma 
special format on disk; it'can then re-create what any file looked like at any point in 
time by adding up all the patches. l 

e Version Control Systems can be divided in 2 categories, 
1. Centralized Version Control System (cvcs) 
2. Distributed Version Control System (DVCS) 

1. Centralized Version Control System (CVCS) 

e The major issue with RCS is that people encmmte ” that aei gn PERE | 
with developers on other systems. To deal with this prob E = amps 
Control Systems (CVCSs) were developed. nee systems See a p : oe 
and Perforce) have a single server that contains all the eee ane HE 
of clients that check out files from that central place. For many years, 


the standard for version control. 


DevOps : MCA [Management - Sem. IV] 2.4 


Version Control - Gr 


Centralized version control systems contain just one repository, and each user gets 

their own working copy. You need to commit to reflecting on your changes in the 

repository. It is possible for others to see your changes by updating. In CVCS, two 

things are required to make your changes visible to others which are, commit and 

update. 

Even though it seems pretty good to maintain a single repository, it has some major 

drawbacks like, ; 

o It is not locally available: So, you always need to be connected to a network to 
perform any action. 

o High probability of losing data: Since everything is centralized, in any case of 
the central server getting crashed, it may result in losing the entire data of the 
project. 


Computer A 


Version Database 


Computer B 


Fig. 2.2: Centralized Version Control System 


2. Distributed Version Control System (DVCS): 


Distributed version control systems contain multiple repositories. Each developer has 
their own repository and working copy. So, that means even you do some changes by 
committing, other developers have no access to your changes. This is because commit 
will reflect those changes in your local repository, and you need to push them in order 
to make them visible on the central repository. Similarly, when you update, you do 
not get other’s changes unless you have first pulled those changes into your 


repository. In DVCS, there are 4 main operations named as, commit, push, pull, and 
update. ’ ’ 


De 


e Ifyou use DVCS, you can hav 


o Alloperations (except pus 
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Server Computer 
Version Database 


Version 3 


Version 2 


Version 1 


Computer A Computer B 


Version Database 


Version Database 


. Fig. 2.3: Distributed Version Control System — 
e the following advantages over cvcs. 


h & pull) are very fast because it only needs to access the 
you do not always need an internet 


hard drive, not a remote server. Hence, 


connection. 
Committing new change-sets can be done lo 


on the main repository. 
Since every anh has a full copy of the project repository, they can share 


changes with one another if they want in any case. 
If the central server gets crashed at any point of time; 
recovered from any one of the contributor’s local repositories. 


cally without manipulating the data 


the lost data can be easily 


a aaa 
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DIFFERENCE BETWEEN CVCS AND DVCS - 


`e Following are the important differences between Centralized Version Control ang 


Distributed Version Control. 
[sr.No.| Key | Distributed Version Control 
In DVS, each client can have a 


1. Working 
local branch as well and have 


a complete history on it. 
Client needs to push the 
2. Learning 
Curve 


Table 2.1 


Centralized Version Control 


In CVS, a client needs to get 
local copy of source from 
server, do the changes and 
commit those changes to 
central source on server. 


changes to branch which will 
then be pushed to server 
repository. 


DVS systems are difficult for 


CVS systems are easy to learn 
beginners. Multiple 


and set up. 


remembered. 


Working on branches in 
easier in DVS. Developer faces 
lesser conflicts. é 


Working on branches in 
difficult in CVS. Developer 
often faces merge conflicts. 
DVD systems are workable 
offline as a client copies the 
entire repository on their 
local machine. 


CVS system do not provide 
offline access. 


DVS is faster as mostly user 
deals with local copy without 
hitting server every time. | 


If DVS server is down, 
developer can work. using 
their local copies, 


CVS is slower as every 
command need to. 
communicate with server. 


If CVS Server is down, 
developers cannot work. 


A SHORT HISTORY OF GIT ° 


e The Linux kernel is an open-source software project of large scope. During the early 
years of the Linux kernel maintenance (1991-2002), changes to the software were 
passed around as patches and archived files. In 2002, the Linux kernel, project began 
using a proprietary DVCS called BitKeeper. 


.e In 2005, the relationship between the community that developed a Timu kernel and 


the commercial company that developed BitKeeper broke down, and the tool’s free-. 


of-charge status was revoked. This prompted the Linux development community (and 


commands need to bej 
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in particular Linus Torvalds, the creator of Linux) to develop their own tool based 
sed on 


some of the lessons they learned while usinø p; 
system were as follows: ing BitKeeper. Some of the goals of the new 


o Speed 
o Simple design 
p Strong pipron or non: linest development (thousands of parallel branches) 
o Fully distributed 
s valleta handle large projects like the Linux kernel efficiently (speed and data size) 
e Since from year 2005, git is easy to use and yet retain these initial qualities. It is very 
useful for large projects, and its incredible branching system is very useful for non- 
linear development. 
In 2005, for the development of Linux kernel, Linus Torvalds needed a new version 
* control system So he went offline for a week, wrote a revolutionary new system from 
scratch, and called it git. Fifteen years later, the platform is the undisputed leader ina 
crowded field. — 
Worldwide, many of the start-ups, collectives and multinationals, including Google 
code of their software projects. Some 


ommercial hosting companies such as 
d gitLab (founded in 2011). 


and Microsoft, use Git to maintain the source 
~ host their own git projects, others use Git via c 
gitHub (founded in 20 07), Bitbucket (founded in 2010) an 
The largest of these, gitHub, has 40 million registered develope 


Microsoft for a whopping $7.5 billion in 2018. 
ge git (and its competitors) is sometimes categorized as a version control system WES): 
sometimes a source code management system (SCM), and sometimes a revision 


control system (RCS) 


e The best indication of git’s ma ance is a survey of developers by Stack 


ket domin 


Overflow. 


e. Traditionally, version control 

—or repo—on a central server. 
ndation Version Control (TFVC 
fine in a corpora 
dertaken by an in-house 
ell if you 
ing voluntarily, 
which is all typical with Open- 


was Client server, SO the code sits in a single repository 
‘Concurrent Versions System (CVS), Subversion and 
FVC) are all examples of Client-server systems. 

te environment, where 
development team with good 
have a collaboration involving 


Team Fou 


e A Client-server VCS works 
tightly controlled and 
network connections. 
hundreds or thousands of deve 
remotely, all eager to try oùt 

_ source Software (OSS) P 


is un 
It does not work so W 
lopers, work 
hings with the code, 


chas Linux. 


newt 


rojects SU 


rs and was acquired by 


development is 


independently, and 
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GIT BASICS 


Git 


Life Cycle: 
Following are stages of Git Life cycle: 


1. Local working directory:.The first stage of a Git project life cycle is the loca) 


working directory where our project resides, which may or may not be tracked, 


git init 


Working Initialization 
Directory = 
= Staging Area 


© git push = git commit 


github Local 
Repository 


Fig. 2.4: git Life Cycle 


2. Initialization: To initialize a repository, we give the command git init. With this 


3. 


4. 


command, we will make Git aware of the project file in our repository. 


Staging Area: Now that our source code files, data files, and configuration files 
are being tracked by Git, we will add the files that we want‘to commit to the 
staging area by the git add command. This process can also be called indexing. 
The index consists of files added to the staging area. 


Commit: Now, we will commit our files using the git commit -m ‘our: message’? 
command. - : Pe : 


Git is Distributed Version Control System. 


e G 


it-helps you keep track of the changes you make to your code. It is basically the 


history tab for your code editor (With no incognito mode?). If at any point while 

coding you hit a fatal error and do not know what's causing it you can always revert 

back to the stable state. So it is very helpful for debugging. Or you can simply see 
. what changes you made to your code over time. 


list1 = [1,2,3] 
list1.append(4) 


listt = [1,2,3] 


list1= [1,2,3] 
list1.append(4) 


list1.pop() 
print(list1) 


print(list1) 


list1 .append(5) 
print(list1) 


#initialFile #addedALine 4#makingChanges 
Fig. 2.5: A simple example of Version History of a File 
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In the above example, all three cards re 
can select which version of the file w 
jump to and from to any version of the 


Present different versions of the same file. We 
e want to use at any point of time. So we can 
file in the Git time continuum. 


- Git also helps you synchronize code between multiple people. So, imagine you and 


your friend are collaborating on a project. You both are working on the same project 
files. Now Git takes those changes 


; ; you and your friend made independently and 
merges them into a single “Master” repository, So, by using Git you can ensure you 
both are working on the most recent version of the repository. So, you don’t have to 


‘worry about mailing your files to each other and working with number of copies of 


Git 


the original file. 
Workflow: 


Before.we start working with Git commands, it is necessary that you understand what 
it represents. 


What is a Repository? 


A repository a.k.a. repo is nothing buta collection of source code. 


There are four fundamental elements in the Git Workflow: Working Directory, 
Staging Area, Local repository and Remote Repository. 


Working . Staging Local Repo Remote Repo 


—S ee 
Git Fetch 


GitAdd =~ Git Commit 
4 = — | l 
, Git Merge ; 


i imple git Workflow 

ig. 2.6: Diagram of a simp 

K ur Working Directory, it can be in three possible states. 

i he files with the updated changes are marked to 
but not yet committed. 

les with the updated changes are not yet 


If you consider a filein y 

1. Itcan be staged: Which means t 
be committed to the local repository 

2. It can be modified: Which means the fi 

‘stored inthe local repository. 

3. It can be committed: Which me 
safely stored in the local repository. 


ans that the changes you made to your file are 
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git Commands: 3 


e git add is a command used to add a file that is in the working directory to the staging 


area. 
e git commit is a command used to add all files that are staged to the local repository, 
e git push is a command used to add all committed files in the local repository to the 
remote repository. So in the remote repository, all files and changes will be visible to 
_ anyone with access to the remote repository. 


e git fetch is a command used to get files from the remote repository to the loca] 


repository but not into the working directory. 

e ` git merge is a command used to get the files from the local repository into the 
working directory. . ; 

e git pull is command used to get files from the remote repository directly into the 
working directory. It is equivalent toa git fetchanda git merge. ` 

Process to place file in Git: 


1. Makea gitHub Account. 


First, let's create your user account 


Ban ae e m omens arenema ow ee 


Fig. 2.7 
2. Make sure you have Git installed on your machine. 

e Ifyou are ona Mac, fire up the terminal and enter the following command: 

$ git --version : 
This will prompt open an installer if you don’t already have Git. So set it up using 
the installer. If you have Git already, it will just show you which version of Git you 
have installed. 
e Ifyou are running Linux (deb), enter the following in the terminal: 

$ sudo apt install git-all 
If you are on Windows: 

$ get a mac 
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3. Tell git who you are, 


5 Introduce yourself, Mention your Git username and email address, 
Git commit will use this information to identify you as the author. 
$ git config --global user.name "YOUR_USERNAME" 


since every 


$ git config --global user.email "im_satoshi@musk. com" 
$ git config --global --list # To check the info you just provided 
4. Generate/check your machine for existing SSH keys. 
e Using the SSH protocol, you can connect and authenticate to remote servers 


and services. With SSH keys, you can connect to gitHub without supplying 
your username or password at each visit. 


e Ifyou did setup SSH, every Git command that has a link you replace it by: 
Instead of : https://github.com/username/reponame 
You use: git@github.com:username/reponame.git 
[Note : You can use both ways alternatively. ] 
5. Let us use Git. tae 
e . Create a new repository on gitHub. Now, locate to the folder you want to place 
under Git in your terminal. (You can more learn about this in the link Create a 
repo - gitHub Docs) 
$ cd Desktop/folder name 
Initialize git: or 
e And to place it under Git, enter: 
$ touch README.md # to create a README File for the repository 
$ git. init # initiates an empty git repository 
e Nowedit the README.md file to provide information about the repository. 
6. Add files to the staging area for commit. 
e Now add files to the git repository for commit l 
$ git add # adds all the files in the local repository and 
| stages them for commit 
T OR 
e Ifyou wanttoadda specific file, then use following command: 


$ git add README.md # To add a specific file 


i tages? 
it let us see what files ares . 
ies eno dified files to be committed 


$ git status # Lists all a or mo 

- Commit Changes you made to your git Repo: 
e Now to commit files you added to your git repo: 
-m "First commit” 


$ git commit 
i "" js given SO that the other 


# The message in the 
see what changes you made. 


users can read the message and 
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Uncommit Changes you just made to your Git Repo: 


Now suppose you just made some error in your code or placed an unwa 
file inside the repository, you can unstage the files you just added using; 

$ git reset HEAD~1 

# Remove the most recent commit 

# Commit again! 

Add a remote origin and Push: 


Nteq 


Now each time you make changes in your files and save it, it won't be 
automatically updated on gitHub. All the changes we made in the file are 
updated in the local repository. Now to update the changes to the master: 

$ git remote add origin remote_repository_URL 

# sets the new remote 

The git remote command lets you create, view, and delete connections to 
_ other repositories. 

$ git remote -v i : 

# List the remote connections you have to other repositories. 


e The git remote -v command lists the URLs of the remote connections you have 
to other repositories. ; may 


$ git push -u origin master # pushes changes to origin 


the remote repository you specified as the origin. 

` See the Changes you made to your file: ra. 

¢ Once you start making changes on your files and you save them, the file won't 
match the last version that was committed to Git. To see the changes you just 
made: ee. 
$ git diff # To show the files changes not yet staged 

Revert back to the last committed version to the git Repo:. 

e Now you can choose to revert back to the last committed version by entering: 
$ git checkout. i 
OR fòr a specific file 
$ git checkout -- <filename> 

View Commit History: 


e You can use the git log command to see the history of commit you made to 


your files: 
$ git log Ae 
e Each time you make changes that you want to be reflected on gitHub, the 
following are the most common flow of commands: 
$ git add. 
$ git status # Lists all new or modified files to be committed 
$ git commit -m "Second commit" | 
$ git push -u origin master 


Now the git push command pushes the changes in your local repository up to 
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7, How to download and work A Version Control - GIT 


: ther itor; 2 
Cloning a Git Repo: repositories on gitHub? 
e Locate to the directory 
z you wan 
repository you want and t to clone the repo, Copy the link of the 


enter the following: 
$ git clone remote_repository URL 


Pushing Changes to the Git Repo: 
e Now you can work on the files i 
i you want and commit t 

want to push changes to that reposi it to changes locally. If you 


ory you either have to be added as a 
collaborator for the reposito 
or you have cr i 
pea ry ory eate something known as pull 


Creating a pull request: 


Create a pull request to propose and collaborate on changes to a repository. 
These changes are proposed in a branch, which ensures that the default 
branch only contains finished and approved work. 

1. On gitHub.com, navigate to the main page of the repository. 


2. In the "Branch" menu, choose the branch that contains your commits. 
Kindly refer below Fig. 2.8. 


6 


P 52branches ©3 tags 


P main ~ 


- Switch branches/tags x 
: ax iN 


Branches Tags 


my-patch-1 


myarb-patch-1 
P Create branch: my from ‘main’ 


View all branches 


` Fig. 2.8 
in the yellow banner, click Compare & pull request 


ist of files, 
3. -Above the list 0 the associated branch. 


to create a pull request for 


H octo-repo had recent pushes less than a minute ago 


lect the branch you'd like to 
; dropdown menu to se : 
saponins ee aa and then use the compare branch drop-down 
merge your ' 


angesin. 
enu to choose the topic branch you made your chang 
m 


ee 


a oe Saf 
a a aaa a a a 


5. Type a title and description for your pull request. 


6. To create a pull request that is ready for review, click Create Pull Request, 
To create a draft pull request, use the drop-down and select Create Draft 
Pull Request, then click Draft Pull Request. 
Collaborating: 


Verslon Control - GIT 
10. Push (send) your changes from 


BRANCHNAME with the name of 


your branch: ` 
git push origin BRANCHNAME 


So imagine you and your friend are collaborating on a project. You both are 


11, Git prepares, compresses, and send 
working on the same project files. Each time you make some changes ang 


S the data. Lines from the remote repository 


(here, gitLab) are prefixed with remote like this: 
push it into the master repo, your friend has to pull the changes that you Enumerating objects: 9, done. 
pushed into the git repo. Meaning to make sure you're working on the latest Counting objects: 100% (9/9), done. 
version of the git repo each time you start working, a git pull command is Delta compression using up to 10 Ahad 
the way to 80. =e : kt Compressing objects: 100% (5/5), 
GIT COMMAND LINE: . 


done. 
Writing objects: 100% (5/5), 
e Toadd a new file from the command line: 


1.84.KiB | 1.84 MiB/s, done. 
1. Opena terminal (or shell) window. 


Total 5 (delta 3), reused 0 (delta ð), pack-reused @ remote: 


as remote: To create a merge request for BRANCHNAME, visit: 
2. Use the “change directory” (cd) command to go to your GitLab project’s folder, remote: https: //gitlab.com/gitlab-org/gitlab//merge_requests/new?merge.. 
Run the cd DESTINATION command, changing DESTINATION to the location of ` request%SBsource_branch%SD=BRANCHNAME 
your folder. 7 i remote: To https://gitlab.com/gitlab-org/gitlab.git 
3. Choose a Git branch to work in. You can either: i ' ' ' t 
; [new branch] - BRANCHNAME -> BRANCHNAME branch 'BRANCHNAME' set up to 
o Create a new branch to add your file into. Don't submit changes directly to the track ‘origin/BRANCHNAME' 
oe Se eee a none bi aii as oe a se ee and yong e Your file is now copied from your local copy of the repository, up to the remote. 
Swit ei existing b : h repository at gitLab. To create a merge request, copy the link sent back from the 
o Switch to an existing branch. ; indo 
remote repository and pastes it into a browser window. 
4. Copy the file into the appropriate directory in your project. Use your standard tool ami 
for copying files, such as Finder in mac OS, or File Explorer in Windows. INSTALLING GIT 
5. In your terminal window, confirm that your file is present in the directory: e Git has a very light footprint for its installation. For irae, you can simply 
o Windows: Use the dir command, copy the binaries to a folder that is on the executable searc - i A eee 
‘ : : ; i ue distribution for e 
o All other operating systems: Usè the ls command. You should see the name e Git is primarily written in C, which means eee isa ene SOOO na as 
of the file in the list shown. è ` supported platform. The git installers can be foun (te available there for 
; sever 
6. Check the status of your file with the git status command. Your file's name (https: //git-scm.com/downloads). Sa ae ihe inatallatlonmanusliy. 
should be red. Files listed in red are in your file system, but Git isn’t tracking them those who don't want to go through the has 
yet. INSTALLING ON LINUX 
7. Tell Git to track this file with the git add FILENAME command, replacing - ; : 
i i Unix: 
FILENAME with the name of your file. Download For linux and 
8. 


Check the status of your file again with the git status command. Your file’s 


name should be green. Files listed in green are tracked locally by Git, but still need 
to be committed and pushed. 


9. Commit (save) 


; our Linux 

e Itis easiest to install Git on Linux using the preferred package manager ofy 
distribution. 

Debian/Ubuntu: 


! *. z st stable ersion 


git commit -m "DESCRIBE COMMIT IN A FEW WORDS" $ apt-get install git 


S : MCA [Mana nt- Sem, 2.16 OTN CONA a Gi 
aatra. D" 
Ubuntu: 


$ add-apt-repository ppa:git-core/ppa # apt update; apt install pit 
Fedora: 


$ yum install git (up to Fedora 21) 

$ dnf install git (Fedora 22 and later) a 
INSTALLING ON WINDOWS | it i a 
. Browse to the official Git website: https ://git-scm. com/downloads 
Click the download link for Windows and allow the download to complete. 


Browse to the download location (or use the download shortcut in your browser), 
Double-click the file to extract and launch the installer. 


Downloads 
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How to launch Git in Windows? 


e Git has two modes of use: 


1 Abash scripting shell (or command line) 
2. Graphical User Interface (GUT) 
Launch Git Bash Shell: 


e Tolaunch git Bash open the Windows Start menu,t 


ype git bashand press Enter. 
Download for mac OS: 


e There are several options for installing git on mac 
distributions are provided by third 
source release. 


OS. Note that any non-source 
parties, and may not be up to date with the latest 
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plomebrew: 
, Install homebrew if you don't already Rave jr then: 
$ brew install git ji 
obtaining Source Release: 
» Ifyou prefer to download tha git code from 
of git. visit git's master repository. 
« As of this writing, the master repository for git sources is tto: //git.kernel.org in 
the pub/software/sem directory ii i 


e Youcan find a list of all the available versions at. 


htto://kernel. Or g/pubs/software/ scm/ git. 


e Tobegin the build. download the source code for version 1.6.0 (or Eter} and unpack it: 
$ weet http://kernel .org/pub/ software /scm/git/git-9.0. tar.gz 
$ tar xaf git-@.45 tar gr 


$ cd git-@.01 

Verify Git Installation: 

« Type below command on terminal: 
$ git. --version 
git version 1.3.3.4 


its source or if yon want the latest version 


GIT ESSENTIALS | eS 


Working with Git Commands: 
The Git Command Line: 


e Git ts simple to use. fust type git. Without any arguments, Git lists its options and the 
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Set User Credentials: 

* Once you have selected a suitable distribution of Git for your platform, you'll need to 
identify yourself with a username and email address to Git. 

e Inaseparation of concerns most satisfying to the purist, Git doe 
repository authentication or authorization. 

e It delegates this in a very functional way to the protocol (commonly SSH) or operating 
system (file system permissions) hosting or serving up the repository. 

e Thus, the user information provided during your first Git setup on a given machine js 
purely for "credit" of your code contributions. 

e With the binaries on your $PATH, issue the following commands just once per new 
machine on which you'll be using git. 

e Replace the username and email address with your preferred credentials. 


s not directly Support 


git Configuration: 
$ git config --global user.name “rajesh.kale" 
$ git config --global user.email “rajeshkale@gmail.com" 

e These commands store your preferences in a file named. gitconfig inside your home 
directory (~ on UNIX and Mac, and SUSERPROFILE% on Windows). 


ERE CREATING REPOSITORY _ ae | Sa 


e Tocreate a new local git repo in your current directory: 
$ mkdirdevops 
$ cd devops 
$ git init 


e This will create a Git directory in your current directory. Then you can commit files in 


that directory into the repo. 
$ echo "some line" > cicd.yaml 
Tracking changes: 
e To check the current status of a project's local directories and files (modified, new, 
deleted, or untracked), invoke the status command: 
$ git status 


Commit the changes: 


e Issue the git commit command with a commit message, as shown on the next line. 


The -mindicates that a commit message follows: 


$ git commit -m “initial commit” 
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i 


FILE1.txt 


git add FILE1 tt 


=e 


staging area 


git add FILE2. tt . 


fi 


Fig. 2.11: Workflow of git 
The workflow which is described for Git can be broken into three locations: 
On the left, (where FILELtxt and FILE2.txt are), we have the working directory. 
This is where you make changes, and is outside of the .git directory. 
The second place is-the staging area. git add moves stuff from the working 
directory to the staging area. 
Then git commit moves it from the staging area to the permanent repository. 


[0] 


(0) 


See what is modified: 
e Wecan see the difference using below command: 
‘$ git diff ; 
- Example: 


. s t 
warning: TERET ‘cicd.yanl’, LF wil be replaced by CRLF the next tize Git touches 4 


diff --git a/cicd.yanl b/cicd.yaal 
index 9c767e0..4a31f27 100644 


Fig. 2.12 


difference side by side then 


e Ifyou want to see 
7 imdiff 


git config --globaldiff. .toolv 


Ignoring Things: i ch files we want it to ignore. This 
ë ‘ DME, And also tell whi 
eek T se se ae generate d files. It can also be useful for very large files 
is useful for tem 
such as datasets. 


ee 
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The way that we do this is by creating a .gitignore file. This file is just a list of files tg 
ignore. It can‘also recognize wildcard characters. 
For example, say that want to ignore our datasets which are saved as csv files and we 
also have some temporary files that end in .tmp, then our . gitignore file is ag 
follows. 

*.cCSV 

* tmp 

iewing your commits: 

The full list of changes since the beginning of time, even when disconnected from all 
networks: 

$ git log 

$ git log --since=yesterday 

$ git log --since=2weeks 


Stashing: 


Git offers a useful feature for those times when your changes are in an incomplete 
state, you aren't ready to commit them, and you need to temporarily return to the last 
committed (e.g. a fresh checkout). This feature is named stash and pushes all your 
uncommitted changes onto a stack. 


$ git stash 
$ git stash --include-untracked 


When you are ready to write the stashed changes back into the working copies of the 
files, simply pop them back on the stack. 


$ git stash pop 


Undoing Thing: 


One of the greatest aspects about Git is that you can undo almost anything. In the 
end, this means you actually can‘t mess up: Git always provides a safety net for you. 


Fixing the Last Commit: 


No matter how carefully you craft your commits, sooner or later you'll forget to adda 
change or mistype the commit’s message. That's when the “--amend” flag of the “git 
commit” command comes in handy: it allows you to change the very last commit 
really easily. 


$ git commit --amend -m “This is the correct message”. 


Undoing Local Changes: 


If you need to discard all current changes in your working copy and want to restore 


the last committed version of your complete project, the ‘git reset’ command is 
useful. 


$ git reset --hard HEAD 


This tells Git to replace the files in your working copy with the “HEAD” revision 
(which is the last committed version), discarding all local changes. 
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CLONING CHECKING AND COMMITTING 
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Fig. 2.33 
To clone a remote repo to your current directory: 
$ git clone urllocalDirectoryName 
e This will create the given local directory, containing a working copy of the files from 
the repo, and a .git directory i 


FETCH PULL AND REMOTE 


e When comparing git pull vs fetch, git renee 
in all the commits from your remote but doesn t make any ae a Sa r 
On the other hand, git pull is faster as youre performing multip 


git FETCH 


i s fs from a remote 

* The git fetch command downloads comms x to Pe ae want to see what 

oe ae ee ie wee A svn update in that y Si Li = 

how the central history has progressed. butt doesn See ee oie wean 

changes into your repository: See a work. Fetched content has to be 

It has absolutely no effect on your local R This makes fetching a safe 
explicitly checked out using the git eee 


i local repository. 
way to review commits before integrating hematen 


h is a safer alternative because it pulls 


oo 
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When downloading content from a remote repo, git pull and git fetch commands 
are available to accomplish the task. You can consider git fetch the 'safe' version of 
the two commands. It will download the remote content but not update your local 
repo's working state, leaving your current work intact. git pull is the More 
aggressive alternative; it will download the remote content for the active local branch 

and immediately execute git merge to create a merge commit for the new remote 


content. If you have pending changes in progress this will cause conflicts and kick-off 
the merge conflict resolution flow. 


How git fetch works with remote branches? 
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. This output displays the local branches we had previously exa ined b i 
them prefixed with ontgth/, Additionally, we see the Bee a B) ae Ar 
remote-repo. You can check out a remote branch just like a local one iy mee iy a 

in a detached FEAD atate Gust Ilke checking out an old commit) You can a of 

them as read-only branches. To view your remote branches, simply pass the -r flag to 

the git branch command, i 


You can inspect remote branches with the usual git checkout and git log 
commands. If you approve the changes a remote branch contains, you can merge it 
into a local branch with a normal git merge. So, unlike SVN, synchronizing your local 


repository with a remote repository is actually a two-step process: fetch, then merge. 
The git pull command is a convenient shortcut for this process. 
Git fetch commands and options: 


e To better understand how git fetch works, let us discuss how Git organizes and 
Stores commits. Behind the scenes, in the repository's ./.git/objects directory, git 
stores all commits, local and remote. Git keeps remote and local branch commits 
distinctly separate through the use of branch refs. The refs for local branches are 


stored in the ./.git/refs/heads/. Executing the git branch command will output a 


. git fetch <remote> 
list of the local branch refs. 


e Fetchrall of the branches from the repository. This also downloads all of the required 


commits and files from the other repository. 
The following is an example of git branch output with some demo branch names. 


git fetch <remote> <branch> 
oa ii. e Same as the above command, but only fetch the specified branch. 
ee git fetch --all 
featurel 
debug2 


e A power move which fetches all registered remotes and their branches: 
ini en ed git fetch --dry-run 
Examining the contents of the /.gi/refs/heads/ directory would reveal similar output. 


The --dry-run option will perform a demo run of the command. It will output 
ls ./.git/refs/heads/ 


examples of actions it will take during the fetch but not apply them. 
see Examples of git fetch: 
featurel 
debug2 


_ Git fetch a remote branch 


The following example will demonstrate how to fetch a remote branch and ee 
your local working state to the remote contents. In eee example, z us oe sae 
is a central repo origin from which the local repository has been T ə -a 
the git clone command. Let us also assume an additional a >i : ai Fa 
coworkers_repo that contains a feature_branch per we will configur 

With giese assumptions set let us continue the eraty e. i earn 

*. Firstly we will need'to configure the remote repo using scans as 


Remote branches are just like local branches, except they map to commits from 
somebody else’s repository. Remote branches are prefixed by the remote they belong 
to so that you don’t mix them up with local branches. Like local branches, Git also has - 
refs for remote branches. Remote branch refs live in the -/.git/ refs/remotes/ 


directory. The next example code snippet shows the branches you might see after 
fetching a remote repo conveniently named remote-repo: 


PAIS :coworker/ 
git branch -r git remote add coworkers_repo git@bitbucket .org:co 
# origin/main 


coworkers_repo.git 
# origin/featurel 
# origin/debug2 


# remote-repo/main 


ference to the coworker's repo using the repo URL. We will 
tch to download the contents. 


` Here we have created a re 
now pass that remote name to git fe 
git fetch coworkers_repo Cowor 
Fetching coworkers/feature_branch 


kers/feature_branch 
# remote-repo/other-feature 


—E——— 
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* We now locally have the contents of coworkers/feature_branch. We will neeg 


integrate this into our local working copy. We begin this process by using the Bit 5 


using origin/main as a filter: 


checkout command to checkout the newly downloaded remote branch. git log --oneline main, -Origin/main 
git checkout coworkers/feature_branch o approve the changes and mer 

[Note: checking out coworkers/feature_branch’] ; prak commands: ge them into your local main branch, use the 
* You are in ‘detached HEAD' state. You can look around, make experimental changes git checkout main 

and commit them, and you can discard any commits you make in this state without git log origin/main 

impacting any branches by performing another checkout. | Thenwe can use git merge origin/main: 
e If you want to create a new branch to retain commits you create, you may do so (now cit Der Ge Orian ; 

or later) by Heng -b with the checkout command again, > The origin/main and main branches now Debit ty Weenie eae ae 

Example: git checkout -b <new-branch-name> synchronized with the upstream developments. 
e The output from this checkout operation indicates that we are in a detached HEAD it PULL 

state. This is expected and means that our HEAD ref is pointing to a ref that is not in 81 

sequence with our local history. Being that HEAD is pointed at the e The git pull command is used to fetch and download content from a remote 


repository and immediately update the local repository to match that content. 

Merging remote upstream changes into your local repository is a common task in Git- 

based collaboration work flows. 

The git pull command is actually a combination of two other commands, git fetch 
followed by git merge. In the first stage of operation git pull will execute a git 
fetch scoped to the local branch that HEAD is pointed at Once the content is 
downloaded, git pull will enter a merge workflow. A new merge commit will be 


created and HEAD updated to point at the new commit. 


coworkers/feature_branch ref, we can create a new local branch from that ref. The 
‘detached HEAD’ output shows us how to do this using the git checkout command: 
git checkout -b local_feature_branch 
e Here we have created a new local branch named local_feature_branch. This puts - 
updates HEAD to point at the latest remote content and we can continue development 
on it from this point. 
Synchronize origin with git fetch: ; 
e The following example walks through the typical workflow for synchronizing your 


local repository with the central repository's main branch. How does the git Pull work? E 
git fetch origin i : . i ; e The git pull command first runs git fetch which downloads content from 
e This will display the branches that were downloaded: specified remote repository. Then a git serge is executed to pa the Ga e 
ale8fb5..45e6624 main -> origin/main content refs and heads into a new local merge commit. Let us consider the fo: a 
aleSfb5..Se8abic develop -> origin/develop 1 better demonstrate the pull and merging process. Assume we have 
. * [new branch] some-feature -> origin/some-feature : A nas a main branch anda remote origin. 


e The commits from these new remote branches are shown as squares instead of circles 
in the diagram below. As you can see, git fetch gives you access to the entire branch 


structure of another repository. 
Origin / Develop 


i. Bl r 

Fig, 2.15: Repository witha Main and ee 3 ea the point where the 

i ) will download all the int is E. The git pull 
* In this situation, git pul ed. In this example, that point 


Fig. 2.14: Synchronize origin with git fetch local and main branch separat 
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command will fetch the diverged remote commits which are A-B-C. Then the Pull 
process will create a new local merge commit containing the content of the new 


diverged remote commits. 
Remote Origin / Main 


Local main 


Fig. 2.16 ; 
In the above diagram, we can see the new commit H. This commit is a new merge 
commit that contains the contents of remote A-B-C commits and has a combined log 


‘message. This example is one of a few git pull merging strategies. A --rebase option - 


can be passed to git pull to use a rebase merging strategy instead of a merge 
commit. The next example will show how a rebase pull works. Assume that we are ata 
_ Starting point of our first diagram, and we have executed git pull --rebase. 


Remote Origin / Main 


O—-4)-®)-_O—-O-P)--F/}-© 
Fig. 2.17 


In this diagram, we can now see that a rebase pull does not create the new H commit. 
Instead, the rebase has copied the remote commits A--B-—C and rewritten the local 
commits E--F--G to appear after them in the local origin/main commit history. 


Common Options: 


git pull <remote> À 
This command fetches the specified remote’s copy of the current branch and 
immediately merges it into the local copy. This is the same as git fetch <remote> 
followed by git merge origin/<current-branch>. AF 

git pull --no-commit <remote> . 
This command is similar to the default invocation, fetches the remote content but 
does not create a new merge commit. 

git pull --rebase <remote> 

Same as the previous pull instead of using git merge to integrate the remote branch 
with the local one, use git rebase. 
git pull --verbose 


This command gives verbose output during a pull which displays the content being 
downloaded and the merge details, ; 
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Git pull discussion: 

Ld 


explains each step of the pulling 


Origin / Main 


Fig. 2.18: Pulling Process 
You start out thinking your repository is synchronized, but then git fetch reveals 


(9 


` that origin's version of main has progressed since you last checked it. Then git merge 
` immediately integrates the remote main into the local one. 


Git pull and syncing: 


Pulling via Rebase: 
* The --rebase option can be u 


git pull is one of many commands that claim the responsibility of harika taps 
content. The git remote command is used to specify what remote = Ph E 
‘syncing commands will operate on. The git push command is used to upload co 


to a remote repository. 


ee ô 
‘The git fetch command can be confused with git pull command. These tw 


i istinction can 
te content. An important safety distin 
commands are used to download remo 4 sare 
be made between git pullandgit fetch. The git fetch can camera ine a 
i i oa 
option while git pull can be considered unsafe. git Seance git pull will 
content and not alter the state of the li tt eines the local state to match 
i diately atte E ; 

ote content and imme ; t in a conflicted 

bcc acai may unintentionally cause the local repository to ge 


State. 


ed to confirm a linear history by preventing 
developers prefer rebasing over merging. In this 


. Man : an a 
unnecessary merge commits y e flag is even more like svn update th 


, i .-rebas 
sense, using git pull with the --re 
plain git pull. 


D 
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In fact, pulling with --rebase is such a common workflow that there is a dedicateg 


configuration option for it: 


git config --global branch.autosetuprebase always 


After running that command, all git pull commands will integrate via git rebase 


instead of git merge. 
Examples of Git Pull: 


The following examples demonstrate how to use git pull command in common 


situations: 
(a) Default Behavior: 


(b) 


(c) 


A branch is essentially a unique set of code changes with a unique name. Each 
repository can have one or more branches. The main branch is where all the changes ` 


git pull 


Executing the default invocation of git pull will be equivalent to git fetch 


origin HEAD and git merge HEAD where HEAD is ref pointing to the current branch. 
Git pull on remotes: 


git checkout new_feature 
git pull <remote repo> 


This example first performs a checkout and switches to the branch. Following 


that, the git pull is executed with being passed. This will implicitly pull down the 


new feature branch from. Once the download is complete it will initiate a git 
merge. 


Git pull rebase instead of merge: 


The following example demonstrates how to synchronize with the central 
repository's main branch using a rebase: 
git checkout main ` 


git pull --rebase origin 


This simply moves your local changes onto the top of what everybody else has 
already contributed. 


eventually get merged into and it is known as the master (main). Let’s see how useful 
Git branches are with an example. 


o 


fe} 


Assume that you need to work on a new feature for an application. To start work, 
you have to first create a unique branch. 

So, while working you get a request to make a quick change that needs to go live 
on the application today. But the thing is you haven’t finished your new feature. 
So, what you can do is, switch back to the master branch, make the change, and 
push it live. 

Then you can switch back to your new feature branch and finish your work. When 


you're done, you merge the new feature branch into the master brarich and both 
the new feature and that quick change are kept. 


‘BRANCHING _ Ropes mbes | 
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Fig. 2.19: Git Branching 


CREATING THE BRANCHES, SWITCHING THE BRANCHES, 
MERGING | 


e Git uses branching severely to switch between multiple tasks. 


1. Create and Switch Branch. 
.2.. Create a new local branch: 
$ git branch name 
3. List all local branches: 
$ git branch = 
4. - Switch to a given local branch: 
$ git checkout branchname 
5. Merge changes from a branch into the local master: 
$ git checkout master 
‘$git merge branchname 


Integration with remote Repo: 


Push your local changes to the remote at T 
Pull from remote repo to get most recent changes. ] ; 
To fetch the most see updates from the remote repo into your local repo, and pu 
them into your working directory: 

$ git pull origin master 
To put your changes from your local repo m the remote rep 

$ git push origin master 


Git Configuration File: 


; files. 
Git’s configuration files are all simple one settings. . ni 
‘git/config Repository-specific es settings i 
‘~/.gitconfig User-specific configuratio 


a i a te E 


D 


¢ This makes it harder for unstable code to get merged into the main code base, and it 


gives you the chance to clean up your future's history before merging it into the main 
branch. 
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ZKA THE BRANCHES 


In Git, branches are a part of your everyday development process. A branch js a 
version of the repository that diverges from the main working project. It is a feature 
available in most modern version control systems. 

A Git project can have more than one branch. These branches are a pointer to a 
snapshot of your changes. When you want to add a new feature or fix a bug, you 
spawn a new branch to summarize your changes. So, it is complex to merge the 
unstable code with the main code base and also facilitates you to clean up your future 
history before merging with the main branch. Refer the following image to clear idea 
of branching. 


Branch 1 


Master 


Branch 2 


Fig. 2.20: Branching 


Little feature 


Big fedture 
do 


Fig. 2.21: A repository with two isolated lines of development 


ps s ; MCA [Mana ement - Sem. | 2.34 
pe Version Control - GIT 


e above diagram visualizes a repository w; 

bs a little feature, and one for a ieee ra ilk . 
pranches, it’s not only possible to work on both of them in . By 
the main branch free from questionable code, 
, the implementation behind Git branches js much more lightweight than other 
version control system models. Instead of Copying files from directory to directory 
Git stores a branch as F reference to a commit. In this sense, a branch represents the 
tip of a series of commits—it is not a container for commits. The history for a branch 
is extrapolated through the commit relationships, 
. Git branches are not like SVN branches, Git branches are an integral part of your 

everyday workflow whereas SVN branches are only used to capture the occasional 
i large-scale development effort. 


creating Branches: 


development, one 
eveloping them in 
rallel, but it also keeps 


e Itisimportant to understand that branches are just pointers to commits. When you 
create a branch, all Git needs to do is create a new pointer, it does not change the 
repository in any.other way. If you start witha repository that looks like this: 
Main 


| 
O-O-O-9 


Fig. 2.22 
¢ Then, you create a branch using the following command: 
git branch crazy-experiment 
¢ The repository history remains unchanged. All you get is a new pointer to the current 
commit: 5 ee 
Crazy Experiment 
ia i its to it, you need to 
* Note that this only creates the new branch. To start anne eane: ss , r ce 
select it with git checkout, and then use the standard g 
commands. > 
Creating Remote Branches: TEE 
s; The a Fern command also works on remote branches. DE z SS ce 
Sel branches, a remote repo must first be configured and added to 
.git 
ae it te add new-remote-repo https: //bitbucket .com/user/repo.gi 
git remote a S 


ts enore repo ina 
$ git push <new-remote-r h to new-remote-repo 
t branc ; ote 
Thi # pushes Pi aa ee the local branch crazy-experiment to the rem 
1S command will pus 


Tepo <remote>. 


Vorsion Control. 
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Deleting Branches: 


Once you have finished working on a branch and have merged it into the main code 
base, you're free to delete the branch without losing any history: 

git branch -d crazy-experiment 
However, if the branch has not been merged, the above command will output an error 
message: j 
error: The branch ‘crazy-experiment’ is not fully merged. If you are sure 
you want to delete it, run ‘git branch -D crazy-experiment'. 
This protects you from losing access to that entire line of development. If you really 
want to delete the branch (e.g. it's a failed experiment), you can use the capital -D 
flag: 
git branch -D crazy-experiment 
This deletes the branch regardless of its status and without warnings, so uses it 
judiciously. 
The previous commands will delete a local copy of a branch. The branch may still exist 
in remote repos. To delete a remote branch execute the following command: 

git push origin --delete crazy-experiment 

OR 

git push origin :crazy-experiment 3 i 

This will push a delete signal to the remote origin repository that triggers a delete of 


the remote crazy-experiment branch. 
Some more commands and Quick Review: 
INSTALLATION and GUIS: 


With platform specific installers for Git, GitHub also provides the ease of staying up- 


to-date with the latest releases of the command line tool while providing a graphical 
user interface for day-to-day interaction, review, and repository synchronization. 
GITHub for Windows: 


htps://windows.github.com 
GITHub for Mac: 
htps://mac.github.com 


For Linux and Solaris platforms, the latest release j 
website. 


Git for All Platforms 
htp://git-scm.com 


s available on the official git 


SETUP: 


e Configuring user information used across all local repositories : 


o git config --global user.name “[firstnamelastname]” 


Set a name that is identifiable for credit when review version history, 


o “[valid-emaii}” 


set an email address that will be associated wi i 
git config --global color.ui auto na nisi ee 


(2) 
set automatic command line colori 


ng for Git for easy reviewing. 
getup and INIT: | 
configuring user information, initializing and cloning repositories: 
o git init 


Initialize an existing directory asa git repository. 

git clone [url] 

Retrieve an entire repository from a hosted location via URL. 
STAGE and SNAPSHOT: . 


» Working with snapshots and the git staging area: 
o git status 
Show modified files in working directory, staged for your next commit. 
o git add [file] 
Add a file as it looks now to your next commit (stage). 
o git reset [file] 
 -Unstage a file while retaining the changes in working directory. 
o git diff 
diff of what is changed but not staged. 
o git diff --staged 
diff of what is staged but not yet committed. 
o git commit -m “[descriptive message}? 
Commit your staged content as a new commit snapshot. 
BRANCH and MERGE: 
* Isolating work in branches, changing context, and integrating changes : 
o git branch : 
fist your branches. a * will appear next te the currently active branch. 
© git branch [branch-name] ; 
Create a new branch at the current commit 
o git checkout 
Switch to another branch and 
© git merge [branch] 
Merge the specified branch’ 
© git log 
Show all commits in the 
INSPECT and COMPARE : 
Examining logs, diffs and object info 
o git lo 
Show k commit history for the curre 


o 


check it out into your working directory. 
s history into the current one. 
current branch's history. 


rmation. 


ntly active branch. 
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git config --global user. email 
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Bit log branchB..branchA 

Show the commits on brancha that are not on branch, 

Bit log --follow [file] 

Show the commits that changed file, even across renames. 

Bit diff branchB...brancha 

Show the difference of what is in branch thatis not in branchB. 
Bit show [SHA] 

Show any object of Git in the human-readable format, 


TRACKING PATH CHANGES: 
* Versioning file removes and path changes. 


© 


git ra [file] 
Delete the file from project and stage the removal for commit. 


ce git ev [existing-path] [new-path] 


© 


Change an existing file path and stage the move. 
git log --stat -M 
Show all commit logs with indication of any paths that moved. 


IGNORING PATTERNS: 


Preventing unintentional staging or committing of files. 
logs/ 
*.notes 


pattern*/ 


Save a file with desired patterns as Git ignore with either direct string matches or 
‘wildcard globs. 


git config --global core.excludesfile [file] 
System wide ignore pattern for all local repositories. 


SHARE and UPDATE: 


Retrieving updates from another repository and updating local epos 


° 


git remote add [alias] [url] 

Add a git URL as an alias. 

git fetch [alias] 

Fetch down all the branches from that git remote, 

git merge {alias]/[branch] 

Merge a remote branch into your current branch to bring it up to date. 
git push [alias] [branch] 

Transmit local branch commits to the remote repository branch. 

git pull 


Fetch and merge any commits from the tracking remote branch. 


Version Co ‘ 
SN SON! s G 


rEMPORARY COMMITS: 
, Temporarily store modified, tracked files in order 
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— 

qgwRITE i ata ee 
R 


branches, updating co 
rewriting g Commits and cleari 
git rebase [branch] Sghir: 


Apply any commits of current branch ahead 
git reset --hard [commit] of specified one. 


Clear staging area, rewrite working tree feg 


(2j 


0 


m specified commit. 


T to change branches. 
git stash 


Save modified and staged changes. 
o git stash list 
List stack-order of stashed file changes, 
o git stash pop 
Write working from top of stash stack. 
o git stash drop 
Discard the changes from top of stash stack. 


° 


e Version control systems are used im all phases of software development. 
¢ Global Information Tracker (git) I made for it which is distributed version control 
system. . 
e There are various types of versicn control systems like Local, CVCS, DVCS. 
‘3 + t 
e Gitalso helps you synchronise codebetween multiple pecple. . 
e There are various commands used for Git starting from repository creation till 
branching. 
e Git branches are a part of your eephy naei process. Git branches are 
effectively a pointer to a snapshot of your changes. 
Check Your Understanding 
= = 
1. Which Command is used te show limited number af commits 
itlog -n 
(a) git fetch : a art 
gr 
(c) git config 
to be used 
2. Which command defines the author email 
current user? 
(a) git clean-f 
(c) git merge-no-ff 


for all commits by the 


() git config-global user.email 
(d) git email-amend 


ing directory- 
3, ___ removes untracked files from Ages 
(a) git commit (d) gitreset 


(c) gitclean 
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Which of the following two commands used to compare two specific branches? 
(a) git diff.. (b) git merge 
(c) git blame-L, (d) git push-tags 


Git belongs to the generation of Version Control tools. 

(a) 1" (b) 4" 

(c) 2" (d) 3" 

What language is used in Git? 

(a) € (b) HTML 

(c) PHP (d) C++ 

How to create copy ofa lab under your own GitHub account so that you can 
solve the lab? 

(a) gitclone (b) git fork 


(c) git pull-request (d) Forking it via the GitHub interface © 

Where is a branch stored inside a Git repository? 

(a) Inside .git/refs directory 

(b) Inside either .git/refs directory or .git/packed-refs file 

(c) Inside .git/packed-refs file 

(d) Inside either .git/branches file or .git/packed-refs file a 

A keeps track of the contributions of the developers working as a team on 

the projects. 

(a) CVS (b) DVF - 

(c) vcs ` (d) LFS 

The files that can be committed are always present in git 

(a) working directory (b) staging area 

(c) unstaged area (d) Anywhere 
Answers 


Practice Questions 


Q.I Answer the following questions in short. 


What is Git? 

State the types of version control systems. 

What are three possible states of file in directory in git workflow? 

What is the meaning of commands: push, commit? 

Which command is used to check whether git is installed or not in Operating 
system? 

How to clone a remote repo to your current directory? 

How to crate and switch local branch on git? 

Explain any two commands for tracking change in git. 
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gil answer the following questions, 
4, Whatare various types of version control systems? 
9, Differentiate between centralized version co 
control systems. 
Explain in brief Git Life cycle. 
Explain in brief git workflow, 
State the various steps how git is used in Command Line. 
what are the steps to create repository in the git? 
Explain git fetch command with their various options. 
8. How git pull works? 
QII Write short notes on: 
4. Local Version Control Systems 
Staging Area 
git fetch 
git pull 
Branching in Git 


ntrol systems and distributed version 


Naweaw 
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Chef for Configuration 
Management 


Objectives... 


After learning this chapter you will be able to: 
m] Understand the creation of server workstation, client and repository for chef 
configuration management. 


Œ= Understand actual working handling of various chef commands for nodes and data 
bags creation. 


| WORKSTATION, CLIENT, REPOSITORY etc.) SERVERS AND 
NODES CHEF CONFIGURATION CONCEPTS 


translate infrastructure into code. This enables a development and deployment 
process with better testing, efficient and predictable deployments, centralized 
versioning, and reproducible environments across all servers., 

Chef has Client-server architecture and it supports multiple platforms like Windows, 
Ubuntu, Centos, and Solaris etc. It can also be integrated with cloud platform like 


AWS, Google Cloud Platform, and Open Stack etc. Before getting into Chef deeply let 


us understand Configuration Management. 
For example, a system engineer in an organization wants to deploy or. update 


software or an operating system on more than hundreds of systems- in the- 


organization in one day. He can do it manually but with so many errors and some 


software may get crash while in progress. Sometimes it is impossible to revert back to . 


previous version. Such issues can be solved with Configuration Management. 
Configuration Management keeps all software and hardware-related information of 
an organization and also repairs, deploys and updates whole application. With the 
help of Configuration Management, it is helpful to do such task with multiple system 
administrators and developers who manage many servers and their applications. 
Chef is the important tool for configuration management in DevOps. 

(3.1) 


OVERVIEW OF CHEF; COMMON CHEF TERMINOLOGY (SERVER, | 


Chef is a declarative configuration management and automation platform used to . 
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j i Chef for Contiguration Management 
tee d of Chet: 


ifyou want to move to a new office an 


' he new office, then system managem 


BVT 
© 
‘he > B e 
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_ Infrastructure Code Continuous Integration 


Continuous Delivery 


my «ec 


Staging AT 


Continuous Deployment 
` Fig, 3.1: Need of Chef 


Production 


Benefits of Chef: 

1. Speed up Software Delivery: When your infrastructure is automated all the 

software requirements like testing, creating new environments for software 
deployments etc. becomes faster. 

2. Risk Management: Chef lowers risk and improves compliance at all stages of 

deployment. It reduces the conflicts during the development and production 


environment. : ; 
i 3 ; tructur ed it 
3. Increased Service Resiliency: By making the infras e automat 


monitors for bugs and errors before they occur. It can also recover from errors 
more quickly. l 

4. Cloud Acceptance: Chef can be easily adapte 
servers and infrastructure can be easily con 
automatically by Chef. N 

5. Managing Data Centers and Cloud Enviro 
platforms. Under chef you can manage @ 
including servers. i 

6. Efficient IT operation and Workflow: Š 
deployment starting from building to tes 
monitoring, and troubleshooting. 

Common Chef Terminology: 

1. Chef Server: It contains all data 

recipes, metadata which describes €a 


d to a cloud environment and the 
figured, installed and managed 


nments: Chef can run on different 
ll cloud and on premise platforms 


hef provides a pipeline for continuous 
ting and all the way through delivery, 


guration and it stores cookbooks, 


related to confi n Chef-Client. Chef-Client gives 


ch node i 
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. Cookbooks: 


Chet for Configuration Manasi 
a ae ad =e | 


configuration details to node. Server verifies all changes and does the Paititig of 
workstation with nodes through the use of authorization keys, and then atts} 
communication will start between workstations and nodes, 
. Chef Workstation: The workstation interacts with Chef-server and Chef-nodeg, fi 
is also used to creste Cookbooks. Workstation is a place where all the interaction 
takes place where Cookbooks are created, tested and deployed, and in workstatj 
codes are tested. Workstation is also used for defining roles and environment, 
based on the development and production environment. Some components of 
workstation are: 
© Development Kit: It contains all the packages require for using Chef. 
Chef Command Line Tool: In this place cookbooks are created, tested and 
deployed and through this policies are uploaded to Chef Server. 
o Knife: This Command Line tool is used for interacting with Chef Nodes. 
< Test Kitchen: This is for validating Chef Code. 


Chef-Repo: This is a repository in which cookbooks are created, tested and _ 


maintained though Chef Command Line tool. 


© Cookbooks are created using Ruby language and Domain Specific languages 
are used for specific resources. 


Consider the following figure: 


Eq 


Fig. 3.2: Cookbook 
© A Cookbook contains recipes which specify resources to be used and in which 


order it is to be used. The Cookbook contains all the details regarding the work 
and it changes the configuration of the Chef-Node. 
Main components of a Cookbook: 


© Attributes: These are used for overriding default setting in a node. 


© Files: These are used for transferring files from sub directory to a specific 
path in Chef-client. 


Libraries: These are written in Ruby code and used fo 
resources and recipes. 

o oe This contains information for deploying the cookbooks to each 
n 

Recipes: These are a configuration element that is stored in a cookbook. 
Recipes can also be included in other recipes and executed based on the run 
list. Recipes are created using Ruby language. 


Corktents 


(2) 


r configuring custom 


p 


DevOps : MCA Management - Sam V] 
A. Nodes: Nodes are managed b 


~E Chet tor Configuration Management 
7 Chef and ench note is confi 
s J p gured by installin 
Chef-Client on it. Chef-Nodes ars 4 Machine such as physical, virtual bse 4 
$, Chef-Client: Chief-cliene jg for registering and authenticating node building 
node objects and for configuration of the nodes, Chief-client runs locally on eve 
node to configure the noda pi z 
6. Ohal: This is used far determining the s 
i y S HE system state at beginni i 
Chef-Client. ft collerts all the system configuration data. inst 
WORKSTATION SETUP: HOW TO CONFIGURE KNIFE? EXECUTE. 
SOME COMMANDS TO TEST CONNECTION BETWEEN KNIFE AND 
WORKSTATION 
e For setup, we have to first configure Ruby environm 
developing Chef Policy. 
Steps: 
1. Determine your default shell by ranning: 
echossHELl 


This command will give the path to your default shell such as /bin/tsh for the Zsh 
shell. 


Add the Workstation initialization content to the appropriate shell re fle 
For Bash shells run: 

echo"eval “$(chef sheli<tarst pasn)7 >» 
For Zsh shells run: 

echoewal “$(chef sheli<inerzesn)” 
For Fish shells run: 

echo*ewal (chef shell-tnit fisn)'>> ~/ confle/fisn/contig, fian 
3. Opena new shell windew and run: 

which ruby 
The command should return /cpt/cner-worestatian/ empedded/hin/ ruby. 


3.2.1 How to configure Knife? 


e Knife is a Command Line tool thar provides an interface between 2 local chef-repo 
and the Chef Infra Server. The Knife command line tooi must be configured to 
communicate with the Chef Infra Server as weil as any other infrastructure within 
the organization 
To configure knife te communicate with Chef infra Server for the first time run ant fe 
configure to create a Chef infra credentials file at ~/ cnet ‘credentials . 
Previous Chef Infra setups recommendeg sening up knife with a conftg.rn file. 
Configuring knife with cunfig.rd is still walid, bur anly for warking with a single Chef 
infra Server with a single Chef Infra Server organizanen, 

madie ~/. chet 

HRA AS pe " chef* - treatype “directory” 

Kew-Item -Ltemlype “file” -Path "c:\.chet\conéig.r0 


ent. Ruby is primarily used for 


~/ bashrc 


“ae wf, Esters 
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* The config.rb configuration can include arbitrary Ruby code to extend configuration 
beyond static values. This can be used to load environmental variables from the 
workstation. This makes it possible to write a single config.rb file that can be used by 
all users within your organization. This single file can also be checked in the chef. 
repo, allowing users to load different config.rb files based on which chef-repo they 
execute the commands from. This can be especially useful when each chef-repo 
points to a different chef server or organization. 

Example: config.rb: 
current_dir = File.dirname(__FILE_) 
user = ENV['CHEF_USER"] || ENV['USER"] 
node_name user 
client_key "#{ENV[‘HOME']}/chef-repo/.chef/#{user}.pem" 
chef_server_url 
whttps://api.opscode.com/organizations/#{ENV[ *ORGNAME ' }}" 
syntax_check_cache_path 
“#{ENV[ “HOME *]}/chef-repo/.chef/syntax_check_cache" 
cookbook_path ["#{current_dir}/../cookbooks"] 
cookbook_copyright “Your Company, Inc." 
cookbook_license “Apache-2.e" 
cookbook_email “cookbooks@yourcompany.com" 
# Amazon AWS 
knife[:aws_access_key_id] = ENV['AWS ACCESS KEY_ID'] 
knife[:aws_secret_access_key] = ENV['AWS SECRET_ACCESS KEY' ] 


ORGANIZATION SETUP: CREATE ORGANIZATION; 
‚YOURSELF AND NODE TO ORGANIZATION l 


[3.3.1 Setting up Chef Repository 
* When user will setup Chef for first time in their organization, then he will need a 
Chef Infra repository for saving cookbooks and other work. l 


e The chef-repo is a directory on user workstation that stores everything he need to 
define his infrastructure with Chef Infra: i 


o Cookbooks (including recipes, attributes, custom resources, libraries, and 


templates) 
o Data bags 
o Policyfiles 


e The chef-repo directory should be coordinated with a version control system, such as 
git. All of the data in the chef-repo should be treated like source code. 

e chef and knife commands are used to upload data to the Chef Infra Server from the 
chef-repo directory. Once uploaded, Chef Infra Client uses that data to manage the 
nodes registered with the Chef Infra Server and to ensure that it applies the right 
cookbooks, policyfiles, and settings to the right nodes in the right order ' 
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. Use the chef generate repo command to create the Chef Infra repository. For 
example, to create a repository called chef-repo: 

chef generate repo chef-repo 

RBAC: 

e Chef infrastructure used RBAC (Role-based Access Control). This is used to restrict 
access to objects: nodes, environments, roles, data bags, cookbooks, and so on which 
help to maintain authorization policy. 

Table 3.1; Features of RBAC 


Organization is the top-level entity for role-based access control in 
the Chef Infra Server. Each organization contains the default groups 
(admins, clients, and users, plus billing admins for the hosted Chef 
Infra Server), at least one user and at least one node (on which the 
Chef Infra Client. is installed). The Chef Infra Server supports 
multiple organizations. This includes a single default organization 
that is defined during setup. Additional organizations can be created 
after the initial setup and configuration of the Chef Infra Server. 


Organization 


A group is used to define access to object types and objects in the 
Chef Infra Server and also to assign permissions that determine 
what types of tasks are available to members of that group who are 
authorized to perform them. Groups are configured by organization. 
Individual users who are members of a group will inherit the 
permissions assigned to the group. The Chef Infra Server includes 
the following default groups: admins, clients, and users. For users of 
the hosted Chef Infra Server, an additional default group is 
provided: billing_admins. 

Auser is any non-administrator human being who will manage data 
that is uploaded to the Chef Infra Server from a workstation or who 
will log on to the Chef management console web user interface. The 
Chef Infra Server includes a single default user that is defined 
during setup and is automatically assigned to the admins group. 


la Chef Client is an actor that has permission to access the Chef Infra 
Server. A client is most often a node (on which the Chef Infra Client 
runs), but is also a workstation (on which knife runs), or some other 
machine that is configured to use the Chef Infra Server API. Each 
request to the Chef Infra Server that is made by a client uses a 


private key for authentication 
key on the Chef Infra Server. 


ji 


Chef Client 


that must be authorized by the public 


3.3.2] Create Organization 


Syntax: 


Options: 


d is used to create an organization. (When creating an 


The org-create subcomman 
r the organization is returneg 


organization with this command, the validation key fo 
to STDOUT.) 

Use the org-create, org-delete, org-list, org-show, org-user-add and org- 
user-remove commands to manage organizations. 


chef-server-ctl org-create ORG_NAME "ORG_FULL_NAME” (options) 


where, 
o The name must begin with a lower- 
case letters, digits, hyphens, and underscores, 


characters. For example, chef. 
The full name must begin with a non-white space character and must be between 


1 and 1023 characters. For example, “ABC Software, Inc.” 


case letter or digit, may only contain lower- 
and must be between 1 and 255 


This subcommand has the following options: 


Associate a user with an organization and add them to the admins an 


billing_admins security groups. 
-a USER_NAME, --association_user USER_NAME 
Write the ORGANIZATION-validator.pem to FILELNAME instead of printing it to 


STDOUT. 
-f FILE_NAME, --filename FILE_NAME 


Examples: 


chef-server-ctl org-create ABC Software 

chef-server-ctl org-create staging Staging -a chef-admin 
chef-server-ctl org-create dev Development -f /tmp/id-dev.key 
chef-server-ctl org-create dev Development --association_usergrantmc  _ 


TEST NODE SETUP: CREATE A SERVER AND ADD TO 
£ ORGANIZATION, CHECK NODE DETAILS USING KNIFE p 


| 3.4.1 Create a Server and Add to Organization 


‘Following are the steps to be followed for creating a server and adding to 
organization: 

4. Choose a Server: You need to select a server to host the Chef components. The 
most common choices are your own infrastructure (physical or virtual servers) OF 
cloud platforms such as Azure, AWS, or Google Cloud Platform. 

2. Install Chef Server: 
(a) Download the Chef Server Package: Visit the Chef downloads page and 
obtain the Chef Server package compatible with your operating system. 
(b) Install the Package: Follow the installation instructions provided by Chef t° 
install the Chef Server on your selected server. 
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3, Configure Chef Server: 

(a) Initial Configuration: During installation, you might need to provide initial 
configuration details such as the server name, organization name, and 
administrator user. 

) SSL Configuration: Configure SSL certificates for secure communication with 
the Chef Server. 

Set up Organizations: Chef Server uses the concept of organizations to manage 

different groups within your configuration management environment Here is 

how you can set up organizations: 

(a) Access the Web UI: Chef Server typically comes with a web-based user 
interface (usually accessible at https: //<chef-server-hostnaze>). 

(b) Create an Organization: From the web UI, you can create an organization. 
Each organization will have its own separate configuration data, policies, and 


users. 


s. Configure Workstations: 
(a) Install Chef Workstation: Install the Chef Workstation on your development 


machine. The Chef Workstation provides tools for developing and testing Chef 


Code. 
(b) Create 
and confi 
6. Manage Nodes: 
(a) Bootstrap Nodes: Nodes are the servers you want to manage using Chef. You 
need to bootstrap them to establish a connection with the Chef Server. 
Recipes that define how 


(b) Apply Configurations: Write Chef Cookbooks and 
your infrastructure should be configured. Upload these to the Chef Server. 


(c) Assign Nodes to Organizations: Assign nodes to specific organizations on the 


Chef Server. 
7. Manage Cookbooks: 

(a) Upload Cookbooks: 
knife Command-line 
(b) Associate Cookbooks: Associate 

8. Manage Roles and Policies: 
(a) Create Roles: Define roles that describe the d 
(b) Create Policies: Policies are used to define 
attributes for nodes. a 
: Use Chef's configuration management capabilities to 
äi APE ine desired configurations j your nodes based on the recipes, cookbooks, 

ici efined. l 

Re ee Cae eae overview, and the actual steps might involve more 
member that this is a high Se areni Aye 


f: 5 5 our specific setu 
serra et ee ae y for the most accurate and up-to-date 
o the ocum 


ntation 
instructions. 


Chef Repository: Create a directory to store your Chef Code, recipes, 


gurations. This will be your Chef repository. 


To upload your Cookbooks to the Chef Server, use the 


tool from the Chef Workstation. 
Cookbooks with specific nodes or roles. 


esired state of a node. 
versioned sets of cookbooks and 


Ce 
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| 3.4.2 | Check Node details using Knife 
e Use the knife node subcommand to manage the nodes that exist on a Chef Infra 
Server. 
* The following examples show how to use this knife subcommand: 
1. List All Nodes: To list all nodes associated with your Chef Server: 
knife node list 
2. Show Node Details: To view detailed information about a specific node: 
knife node show NODE_NAME 
Replace NODE_NAME with the name of the node you want to view. 
3. Search Nodes: You can use the knife search subcommand to search for nodes 
based on specific criteria. For example, to search for nodes with a specific role: 
; knife search node ‘roles:ROLE_NAME" 
Replace ROLE_NAME with the name of the role you are searching for. 


Chet for Configuration Manage 
Lo Bt | emen 


4. Filter Nodes: You can filter the nodes displayed based on specific criteria using 


the knife node list command with filters. For example, to list nodes with a 
specific environment: l 

knife node list 'chef_environment:ENVIRONMENT_NAME' 
Replace ENVIRONMENT_NAME with the name of the environment. 


5. Node Attribute Values: Using the knife exec command,you can query and 
display specific attribute values of nodes. For example, to display the value of a 
specific attribute for all nodes: 


knifeexec -E “nodes.all { |n] puts n['attribute_name'] }" 
Replace attribute_name with the attribute you want to display. 


Remember to replace placeholders like NODE_NAME, ROLE_NAME, and ENVIRONMENT_NAME 
with your actual node, role, and environment names. 


The knife command can be quite versatile. This command allows you to perform a wide 


range of actions related to Chef Server management. To explore more options and » 
subcommands, you can refer to the official Chef documentation or use the --help flag - 


with any knife subcommand to get detailed usage information: 
knife SUBCOMMAND --help f 


` For example, 
knife node show -- help € 
| NODE OBJECTS AND SEARCH 


In Chef, nodes are representations of individual servers or systems that are managed 
using the Chef Configuration Management tool. Nodes store information about the 
state of a server, its attributes, run lists, environment, and other relevant details. You, 
interact with nodes to define how they should be configured and maintained. 

Here's a brief overview of node objects and how node search works in Chef. 
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Node Objects: 

A Node Object in Chef is a JSON document that contains various pieces of information 

about a server, including: 
o Node Name: A unique identifier for the node. 
o Environment: The environment the node belongs to (e.g, development, 
production). 
o Run List: A list of recipes and roles to be applied to the node. 
ò Attributes: Custom data that describes the node's desired configuration. 
o Automatic Attributes: Information collected by the Chef client, like platform 
details, IP addresses, etc. 
o Policy: Information about the policy applied to the node. 
o Ohai Data: System information collected by the Ohai tooL 
o Tags: User-defined tags to help organize nodes. 
Node Search: 
e Node search in Chef is a powerful feature that allows you to find nodes based on 
specific criteria. You can use node search to identify nodes with certain attributes, 
roles, or any other data stored in the node object. The search results can then be used 
to manage and manipulate nodes more effictently. 
e The knife search command is used to perform node searches. Here's how you can use 
it: 5 aK 
o Tosearch for nodes with a specific role: 
"roles:my_role” 

o Tosearch for nodes ina specific environment: 
"chef_environment :my_environment” 

o Tosearch for nodes with a specific attribute: 
“my_attribute: attribute_value” 

o Tosearch for nodes with a combination of criteria: 
“role:web_server AND chef_environment : production” 

* You can also use regular expressions, range queries, and more advanced search 


techniques to narrow down your results. i ) 
* Node search can be particularly helpful when managing a large infrastructure with 


many nodes, as it allows you to dynamically identify nodes and apeerecnepE amas 


_based on their attributes and roles. x ee eee a “ 
ENVIRONMENTS: HOW TO CREATE ENVIRONMENTS, ADD 


SERVERS TO ENVIRONMENTS? 


ve a separate environment for development, testing, and 
uping nodes into separate environments to support an 


° Itis always a good idea to ha 
Production. Chef enables gro 
ordered development flow. 


we 
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For example, one environment may be called “testing” and another may be called Create Roles 
"production". Since you don't want any code that is still in testing on your production hod 4: 1n Chef Server directly 
machines, each machine can only be in one environment. You can then have one Me T a cela croite iunii 
configuration for machines in your testing environment, and a completely different 
configuration for computers in production. 

e Additional environments can be created to reflect each organization's patterns and . Save & exit 
workflow. For example, Creating production, Staging, Testing, and Development The role will be created in Chef Server. 
environments. Generally, an environment is also associated with one (or More) example: 


Cookbook versions. - name, “web_servers 
description "This role contains nodes, which act as web servers" 


& A 
Add the run list e.g. “recipe(nginx]” under “run_list” 


Default Environment: À run_list "recipe[webserver]" 
° By default, an environment called "_default" is created. Each node will be placed into default_attributes 'ntp' => 
this environment unless another environment is specified. Environments can be { j 
created to tag a server as part of a process group. 'ntpdate' => 
Create Environments: 


e Anenvironment can be created in four different ways: ‘disable’ => true 


o Create a Ruby file in the environments sub-directory of the chef-repo and then } } 
en eee ier ; e Let us download the role from the Chef server so we have it locally in a Chef 
©. Create a JSON file directly in the chef-repo and then push it to the Chef Infra repository . 
Server: > knife role show client1 -d -Fjson> roles/client1.json 
o Using knife. e Now, let us bootstrap the node using knife with roles. 
o Using the Chef Infra Server REST API. . > knife bootstrap --run-list "role[webserver]" --sudo hostname 
e Once an environment exists on the Chef Infra Server, a node can be associated with e Edit the roles in Chef Server using following command. 
that environment using the chef_environment method. . >» knife role edit clienti 


cA ROLES: CREATE ROLES, ADD ROLES TO ORGANIZATION 
e A role defines specific patterns and processes across nodes in an organization as 
belonging to a single job function. 
e Each role has zero or more attributes. Each node has zero or more roles. 


Method 2: In local repo under chef-repo folder. 
’ > viwebserver.rb 


Example: 
name “web_servers" 


e When a role runs ona node, its configuration details are compared to the attributes of description "This role contains nodes, which act as web servers” 
that role. Then, the contents of the run-list of that role are applied to node's run_list “recipe[webserver]" 
configuration details. default_attributes 'ntp' => 
e When running Chef Infra Clients, it combines its own attributes with the run-lists { ; 
contained in each assigned role. 'ntpdate' => 
e Role data is stored in two formats: As Ruby file that contains domain-specific { 
language or As JSON data. ` ‘disable’ => true 
How to use Roles in Chef? : } 
1. Create a Role and add the cookbooks into it. Za 


& then upload to chef server using following commands: 


$ knife role from file path/to/role/file 
3. Thenrun the list. $ knife role from file web_servers.rb 


2. Assign the role into each node or bootstrap new nodes using roles, 
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Assigning Roles to Nodes: 
> knife node list 
$ knife node edit node_name 
OR 
# Assign the role to a node called server: 
$ knife node run_list add server ‘role[web_servers]' 


This will bring up the node's definition file, which will allow us to add a role to its 
run_list: 


{ “name“: “client”, “chef_environment": “_default", 


“normal": 
{ “tags": [ ] Fs “run Aiste f 


“recipe[nginx]" ] } 
For instance, We can replace our recipe with our role in this file: 
{ "name": "client1", “chef_environment”: "_default", "normal": { "tags": [ ] } 


run_list": [ "role[web_server]" ] } 
Method 3: Using Chef Autotmate UI. 


Step 1: Create a Role 


Oraon 


DA pa ë es ë Oyie 


Fig. 3.3 (b) 
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step 3: Edit a Node and Roles i 


Fig. 3.3 (c) 
Step 4: Run knife command from workstation. 


$ knife ssh “role:webserver” “sudo chef-client” 


ATTRIBUTES: UNDERSTANDING OF ATTRIBUTES, CREATING 
CUSTOM ATTRIBUTES, DEFINING IN COOKBOOKS 


Attributes are properties that can be assigned to Cookbooks, Recipes, and Nodes 


Chef attributes are an important part of defining cookbooks and recipés. Attributes 
allow you to specify certain details about a particular recipe, such as which platform 
it is meant for or which cookbook it depends on. 


Attributes can also be used to override the defaults set by a cookbook author 


As we know, Chef Attributes are key-value pairs associated with node or role 
ERE una. and store data about a node. 


ERR] Understanding Chef Attributes 


"Attributes can be defined in several different ways, and they can be used to specify a 
wide range of different settings. For example, attributes can be used to set the 
hostname of a node start or to specify which application should be installed on a 
node. — 

_ Attributes can be used to override default settings for a cookbook or recipe. For 
instance, if a Cookbook contains a default setting for the hostname attribute, that 


setting can be overridden by specifying a different hostname in the attributes list file. 
Types of Chef Attributes: 


* Asa Chef, you will need to be aware with the different attribute types that can be used 
to configure a node run. There are six attribute types that can be assigned to a Chef 
cookbook: default, automatic, normal, force_ default, override, force_override. Each 
type has its own purpose and use case. 


DevOps : MCA [Management - Sem. IV 3.15 Chef for Configuration Mana ement 


1. Default: A default attribute is an attribute that does not have a value set on the 


node. If a default attribute is not set in the default attribute file, the Chef-client 


will use a nil value for the attribute. You can override the default attributes list 
just like any other attribute, which can also be set in the default attribute file. 


2. Automatic: An automatic attribute is set by the Chef-client node itself during the 
Chef-client run. These server attributes are typically set based on information 
gathered from the node such as the operating system type or platform. Automatic 
attributes can be overridden like any other attribute, but they cannot be set in the 
default attribute file. 


3. Normal: This is the most common type of attribute list and is typically used when 
you want to set a specific value for an attribute on a node start. The value for a 
normal attribute can be set in the default attribute file, or it can be overridden on 
a per-node basis. 


4. Force_default: The value for this attribute list is always taken from ihe defail 
attribute file. If the force_default attribute is set on a node, any other values set 
for that node are ignored. This can be useful if you want to ensure that all nodes 
in your environment have the same value for an attribute. 


5. Override: An override attribute will take precedence over any other values that 
have been set for an attribute, including the default value. This type of attribute is 
often used when you need to quickly change the value of an attribute on a node 
run without having to edit the default attribute file. 


6. Force_override: A force_override attribute list overrides any other attribute 
values, whether they are default values or override values. This type of attribute 


should be used sparingly, as it can make it difficult to track down the source of an 
__ attribute value. 


3.8.2] Creating Custom Attributes 


User can create custom attributes for servers, device groups, customers, facilities, OS 


Build Plans, and software policies. Custom attributes values are string values. 
To add, delete, or modify the value of a custom attribute for a server: 

1. Inthe SA Client navigation pane, select the Devices tab. 

2. Select the All Managed Servers node. 

3. Select a server. 
4 


To view the custom attributes defined for the server, select Custom Attributes 


from the View drop-down selector. This displays all the custom attributes defined 
for the server. 


5. Select Actions or right click the server and select Open. This displays information , 


about the server. 
6. Select the Information tab in the navigation pane. 


7. Select Custom Attributes in the navigation pane. This displays all the custom 
attributes defined for the server, 


To add a new custom attribute, select the “+” icon and enter the name of the 
custom attribute. 
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g. To delete a custom attribute, select the custom attribute and select the “-” icon. 


40. To change the value of a custom attribute, double click the value column in the 
appropriate row and enter the new value. 


41, Select File > Revert to discard all your changes. 
42. Select File -> Save to save your changes. 


Defining Attributes in Cookbooks 


i in order to create an attribute file, you will first need to create a new file with ".rb" 


extension. You can do this using any text editor. Once you have created the file, you 
will need to add the following code: 


default["cookbook_name"]["attribute_name"] = "attribute_value" 


Replacing "cookbook_name" with the name of the cookbook that contains the recipe 
.you wish to override and "attribute_name" with the variablename you wish to 
override. The "attribute_value" will-be used to set the value of the variable. Once you 
have added the desired code to the file, save it and then upload it to your Chef server. 


DATA BAGS: UNDERSTANDING THE DATA BAGS,. CREATING, 
AND MANAGING THE DATA BAGS, CREATING THE DATA BAGS 
USING CLI AND CHEF CONSOLE, SAMPLE DATA BAGS FOR 


Per orienta USERS 


EER] Understanding the Data Bags 


Data bags are a way to store and manage global data that can be used across nodes. 
They are essentially encrypted JSON data containers used to store sensitive 
information, configuration settings, or any data that needs to be shared across nodes 


but shouldn't be exposed in plain text. ; 
Data bags are commonly used to store items such as Database connection strings, API 


‘keys, Passwords, and other Configuration data. 


Chef Server 


Node A Node B 
Data Data 


Fig. 3.4: Data bags contain Shared, Global Data 


DevOps : MCA [Management - Sem. IV 3.17 Chef for Configuration Mana ement 
[3.9.2] Creating and Managing the Data bags 
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Following command shows how data bags work in Chef: 


1. Creating Data Bags using CLI: To create a new data bag, you use the knife 
Command Line tool or Chef APIs. Data bags are typically organized by name 
similar to directories in a file system. s 


knife data bag create BAG_NAMEG -NAME 


2. Creating Data Bag Items: Inside a data bag, you store individual items. Each item 
is a JSON object that contains the data you want to store. For instance, if you aré 
creating a data bag for database connection strings, each item might represent a 
different database. 

knife data bag create BAG_NAME ITEM_NAME 

3. Editing Data Bag Items: Once created, you can edit the data bag items using a text 
editor or directly through the command line using the knife tool. 

knife data bag edit BAG_NAME ITEM_NAME 

4. Uploading Data Bags: After creating and editing data bags and their items, you _ 
upload them to the Chef Server using the knife command. - 

knife data bag from file BAG_NAME ITEM_NAME.json 

5. 


Accessing Data Bags in Recipes: In Chef Recipes, you can access data bag items 
and their content. These items can be used to configure resources within your 
cookbooks. 
# Load a data bag item 
my data = data_bag item('BAG_NAME', ‘ITEM NAME") 
# Access attributes within the data bag item 
db_host = my_data['database']['host'] 
db_user = my_data[."database’ ]['username' ] 


Data bags are especially useful for separating sensitive data from Cookbooks and 
configurations, providing better security and separation of concerns. However, it is 
‘important to note that data bags are not inherently encrypted. They can be optionally 
encrypted to enhance security. When encrypted, data bag items can only be 
decrypted by nodes that have the decryption keys. re i 
Data Bags are treated as Global variables like JSON data. They. are indexed for 
searching and accessed during search process. We can access JSON data from Chef. 
For example, a data bag can store global variables such as an app's source URL, the 
instance's hostname, and the associated stack's VPC identifier. 


3.9.3 | Creating the Data Bags using Chef Console 


Log in to the Chef Web console. 

Navigate to "Policy" and then “Data Bags”. 

Click the "Create New Data Bag" button. 

Enter the name of the data bag and click “Create Data Bag". 
Inside the created data bag, click the "Create New Item" button. 


Enter the item's name and provide the necessary data in JSON format. 
Click "Create Item" to save the data bag item. 


NaWPWNP 


Sample Data bags for Creating Users | 


Following example shows how you can create data bags t t 
using Chef. This example will gs to manage user accounts 


l hi show how to create a data bag for user. accounts, 
including their usernames, UIDs, and SSH keys. i 


1. Create the Data Bag: Assuming you have the Chef Workstation set up, here's how 


you can create a data bag for user accounts using the knife command-line tool: 
# Create the data bag 


knife data bag create users 


2. Create Data Bag Items: For each user, you will create a data bag item containing 


their information. Here is how you can create data bag items for two users, Alice 
and Bob: 


# Create Alice's data bag item 
‘knife data bag create users alice 
knife data bag from file users alice.json 
# Create Bob's data bag item 
‘knife data bag create users bob 
knife data bag from file users bob.json 
3. Populate Data Bag Item JSON Files: Here is example of JSON files for the . 
. .alice.json and bob.json data bag items. These files contain information about the 
users, including their usernames, UIDs, and SSH keys. 
alice.json: 


Following is JSON code: 

{ 

è "id": "alice", 
"username": "alice", 
"uid": "1001", 
"ssh_keys": 


"ssh-rsa AAAAB3NzaCly C2EAAAADAQABAAABAQ. : s 
"ssh-rsa AAAAB3NzaClyc2EAAAADAQABAAABAQ. ote 


] 
}, 
_bob.json: . 
7 z "id": "bob", 
"username": "bob", 
"uid": "1002", 
"ssh_keys": 
“ssh-rsa AAAAB3NZaC1yc2EAAAADAQABAAABAQ. ai 
“ssh-rsa AAAAB3NZaC1yCZEAAAADAQABAAABAQ. si 
] 
} 


In these JSON files, the ssh_keys field contains the SSH public keys for the users. 


i tto use. 
You can replace the example keys with the actual public keys you want to 
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4. Using Data Bag Items in Recipes: You can use the data bag items in your Cher 
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e It helps IT teams define and maintain the desired state of servers, applications, 


recipes to create user accounts and set up their SSH keys. Here is a simplifieg 
example of how you might apply the data bag items: 

# In a recipe 

users = data_bag('users') 

users.each do |user_id] 

user = data_bag_item(‘'users', user_id) 

username = user[ ‘username’ ] 

uid = user[‘uid'] 

ssh_keys = user['ssh_keys'] 


check Your Understanding 


and systems, ensuring that they are configured correctly and consistently over 
time. 

Chef uses code-based "recipes" and "cookbooks" to define how resources should be 
configured and it can handle tasks such as installing software, managing user 
accounts, and configuring network settings. This automation helps streamline the 
process of managing complex IT environments, reducing mamil errors and 
enhancing efficiency. 


What is Chef? 


user username do 1. 

uiduid (a) A software recipe book (b) Aconfiguration management tool 

home "/home/ #{username} 4 (c) A programming language (d) Acloud computing platform 

shell "/bin/bash" 2. Which component of Chef is responsible for storing and managing configuration 
manage_home true data? | 

end (a) Chef Workstation . (b) Chef Node 

directory "/home/#{username}/.ssh" do (c) Chef Server . (d) Chef Client 

owner username 3. Whatis the primary purpose of a Chef recipe? ` 


group username 

mode ‘@7@Q' 

end 

file "/home/#{username}/.ssh/authorized_keys” do 
contentssh_keys.join("\n") 

owner username 


* group username 


(a) To define server hardware specifications. 
(b) To install software packages on nodes. 

(c) To manage user authentication. 

(d) To create virtual machine instances. 


< In Chef, what is á "Cookbook"? 


(a) A collection of recipes, templates, and resources. 


. (b) A directory for storing SSH keys. 


mode. ' 0600 ' | 
af (c) A configuration file for the Chef Server. 
T (d) A tool for managing databases. ee 
| interacts Wi eChe er? 
e The above example shows how you can create user accounts and set up their SSH keys 5. Which Chef component runs on nodes andi 


' (b) Chef Server ` 
(d) Chef Client . 
n the context of,Chef? 


based on the data bag items you created. 


(a) Chef Workstation 
(c) Chef Node. 

6. What does "bootstrapping" refer to i 
(a) Grilling recipes over an open flame. 
(b) Initializing a new server and connecting! 
(c) Deploying virtual machines. 
(d) Encrypting sensitive data. 


e In the context of Configuration Management in IT and software development, 2 
"chef" refers to a popular open-source tool called Chef. 

e Chef is used to automate the deployment, management, and configuration of 
software and infrastructure in a consistent and scalable manner. 


it to the Chef Server. 


D 
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7. What does the term "role" represent in Chef? 


10. 


(a) A user's job title. 
(b) A type of cookbook. 
(c) A specific attribute of a node. 
(d) A way to define a server's function and E 
How does Chef use the concept of "idempotence" in its recipes? 
(a) To create complex data structures. 
(b) To ensure that resources are only configured if necessary. 
(c) To manage database schemas. 
(d) To handle user authentication. 
What is the purpose of Chef's "attributes"? 
(a) To store user credentials. 
(b) To define the physical location of servers. 
(c) To configure the behavior of recipes and cookbooks. 
(d) To manage virtual machine instances. 
What is a "data bag" in Chef? 
(a) A container for storing encrypted data. 
(b) A type of cookbook. 
(c) A configuration file for Chef Server. 
(d) A tool for managing databases. 
j Answers 


Practice Questions | 
Q.I Answer the following questions in short. 


VPONAMAUNE, 


What is Chef? 

What is a recipe in Chef? 

What is bootstrapping in Chef? 

What is an attribute in Chef? 

What is a role in Chef? 

How does Chef ensure idempotence? 

What are data bags in Chef? 
How does Chef handle dependencies between cookbooks? 
What is the role of Chef Server in the configuration process? 


Q.II Answer the following questions. 


1. 


What is Chef and how does it work? 

What are cookbooks and recipes in Chef? 

How does bootstrapping work in Chef? 

Explain the role of Chef Server in configuration management. 
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How does the Chef Client work on nodes? 

What are roles and how do they function in Chef? 

Explain the use of attributes in Chef. 

How does data bag work in Chef and when should it be used? 
Explain the process of searching for nodes in Chef. l 


. What is the difference between a cookbook and a recipe in Chef? 
. How does Chef handle idempotence? 

. How do you manage dependencies between cookbooks in Chef? 
. Explain the concept of Environments in Chef. 

. How does Chef ensure security in managing sensitive data? 

. How do you integrate Chef with Version Control Systems? 


Q.III Write short notes on: 


1. 


NAN E a E 


Need of Chef 
Benefits of Chef 
Cookbooks 

Data bags 
Organization set up 
knife command 
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; containers are lightweight, portable, and self-sufficient units of software that 
contain all the necessary dependencies and configuration needed to run an 
eee application. 


pocker has become very popular in recent years, with many companies and 
organizations adopting it as a standard platform for application development and 
deployment. 

in this chapter, we will provide an introduction to Docker and cover some of the key 
concepts and terminology used in the Docker ecosystem. f 
pocker is a tool designed to make it easier to create, deploy, and run applications by 


Ob j ectives... using containers. Containers allow a developer to package up an application with all 
of the parts it needs such as libraries and other dependencies, and ship it all out as 


After learning this chapter you will be able to: i one package. 
Understand how Docker build, test, and deploy applications quickly. With Docker, developers can create containers that include all the necessary 


Docker-Containers 


[m) 
m] Understand how to create Docker images. i dependencies, libraries, and configuration needed to run an application, and then 
m Understand the Docker networking. easily deploy and.scale those containers across different environments, from 
m) Learn how to use volumes for persistent storage using Docker. : development to production. 
[m] Understand how to tag images. ee me ae Bs orri 
on 
m) Understand the working of Docker hub. 3 teeter | 22r 
t INTRODUCTION 
e When we are looking for a containerization solution that provides maximum 
i compatibility in each environment with little or no configuration changes then 


Docker is.a good solution that enables us to create a snapshot of our application and 
all its dependencies. Then we deploy this same snapshot in development, testing, and 
production. In this chapter, we are going to learn Docker basics with networking 


-concepts. 


VERE What is Docker? 


Docker Engine 


Infrastructure 


Fig. 4.2: Container 


41.2 How does Docker Work? ` 
tecture, 


: : ani rchi 
* Docker is built on a Client-server a networks, and the Docker 


managing the containers, images, eae cting with the daemon. 
providing a command-line interface hich are essentially snapshots 


Fig. 4.1:C r images, W š 
£ oneept of Docker * Docker containers are created from Docke mages are stored in Docker 


cker is an. open-source containerizati l ild, e nfiguration. Docker i ‘ 
e Do P tion platform that allows developers to bui of a container's file system ar ie cker Hub) or private (hosted internally by an 


ip, and run applications and services i : eae : i 
ship pp rvices in containers. registries, which can be public 
(4.1) organization). 


with the Docker daemon (server) 
client (client) 


Docker . 
DevOps : MCA [Management - Sem. I 4.3 Container, 


* When a container is created from an image, Docker cr ae ee layer on to 
of the image's file system, allowing the container pi i ae jie e data Withoy 
affecting the underlying image. Containers can De m 7 lik ne scaled usin 
Docker's CLI commands, òr through container orchestration tools like Kubernetes 


The Docker Platform: akon : 

* Docker provides the ability to package and run an application in a loosely isolate d 
environment called a Container. The isolation and security allow you to run ma 
containers simultaneously on a given host. Containers are lightweight and Contain 
everything needed to run the application, so you do not ae to rely on what jg 
currently installed on the host. You can easily share ee walle YOu Work and be 
sure that everyone you share with gets the same container that works in the same 
Way. : 


° Docker provides tooling and a platform to manage the lifecycle of your 


containers: 

o Develop your application and its supporting components using containers, 

o Thecontainer becomes the unit for distributing and testing your application, 

o When you are ready, deploy your application into the production 
environment, as a container or an orchestrated service. This works the same 
whether your production environment is a local data center, a. cloud provider, ora 
hybrid of the two. 


| 4.1.3] Use Case of Docker 


e Docker is a popular containerization technology that has found a variety of use cases ` 


in the real world. Here are some examples: 

1. Application Development: Developers can use Docker to create a consistent 
environment for building and testing applications. This ensures that the 
application behaves the same way in development, testing, and production 
environments. _ 

2. Continuous Integration and Continuous Deployment (CI/CD): Docker can be 

‘used to create containers that are pre-configured with all the necessary 
dependencies to run an application, This makes it easier to deploy applications 
quickly and easily using tools like Jenkins or Travis, 

3. Microservices: Docker makes it easier to develop, deploy, and manage 
microservices. With Docker, each microservice can be packaged into a container, 
making it easier to deploy and scale independently, E aes. 

4. Cloud Migration: Docker containers can be easily moved from one cloud provider 
to another. This makes it easier for organizatio 


i ; ns to migr. i lications t° 
a new cloud provider without having to modify the i, ia. chs 


sea Ce ae ae cen: Docker can be used to create test environments 
that as identical to Production environments This makes it easier t0 test 
applications and ensure that they are working as eae i A es it eas 

cted. . 
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6. Big Data: Docker can be used to create containers for big data applications like 
Hadoop or Spark. This makes it easier to deploy and manage th licati s 
well as to scale them up or down as needed. eee 

7. DevOps: Docker is a key tool for DevOps. This tool allows teams to easily build 
test, and deploy applications in a consistent and repeatable way. j ' 

8. High Availability: Docker can be used to create redundant and highly available 
environments. By running multiple containers of an application, organizations 
can ensure that the application remains available even if one of the containers 
fails. 

9. Security: Docker provides a secure environment for running applications. By 
using containers, ‘organizations can ensure that their applications are isolated 
from the host system and from other containers running on the same host. 

10. IoT: Docker can be used to create containers for IoT devices. This makes it easier to 
manage and update these devices, as well as to deploy new applications to them. 


Dockers Vs Virtualizations 


App 1 App 2 
- Bins/Libs -Bins/Libs 


; - Docker Engine’ 


Host OS 


Docker Architecture Virtual Machine Architecture 


Fig. 4.3: Docker and Virtual Machine Architectures 
. Table 4.1: Difference between Docker and Virtual Machines 
[Docker | Virtual Machines (VMs) 
Virtualization creates a complete | Docker uses a containerization 


virtual machine (VM) with its own approach, where each container 
operating system. shares the host operating system 


kernel. 
Boots in a few seconds. 


Architecture 


It takes a few minutes for VMs to 
boot. 
cae Dockers make use of the| VMs make use of the hypervisor. 
i ine. : 
—e . contd... 


Docker.¢ í 
On : : - 
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Docker - Containers 
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Requires entire OS to be loag 

before starting the surface, so] ed 
efficient. i ess 
Virtual machines Provi 
complete isolation between is 
host and the guest opera; e 
systems. 


s needed to virtualize, 


Memory 
Efficiency 


Deployment | Deploying is easy as only a single 
l image, containerized can be used 

: across all platforms. 

Usage Docker has a complex usage 
mechanism consisting of both 
third party and docker managed 
tools. 

Portability Docker containers can be easily 
moved across different 
environments, including public 
and private clouds. 

Docker containers have smaller 
footprints compared to virtual 
machines. ; 


No space i 
hence less memory. 


ainers share the host 


Docker cont 
-level 


kernel but provide process 
isolation. 


ing 


Docker 


Deployment is comparative} 
J daemon 


lengthy as separate instances are 
responsible for execution. 


Tools are easy to- use and simple; 
to work with. 


Fig. 4.4: Architecture of Docker 


Virtual Machines require more 
effort to move due to their larger 
size and dependency on specific 
hardware. 


1. The Docker Daemon: 

The Docker daemon (dockerd) listens for Docker API requests and manages Docker 
objects such as images, containers, networks, and volumes. A daemon can also 
communicate with other daemons to manage Docker services. 


VMs require a complete guest 
operating system. 


2. The Docker Client: 

The Docker client (docker) is the primary way that many Docker users interact with 
‘Docker. When you use commands such as docker run, the client sends these 
‘commands to dockerd, which carries them out. The docker command uses the Docker 
API. The Docker client can.communicate with more than one daemon. 


ARCHITECTURE 


3. Docker Desktop: : 
Docker Desktop is an easy-to-install application for Mac, Windows or Linux 


environments that enables you to build and share containerized applications and 
microservices. Docker Desktop includes the Docker daemon (dockerd), the Docker 
client (docker), Docker Compose, Docker Content Trust, Kubernetes, and Credential 


Helper. 


4. Docker Registry: | 

° A Docker registry stores Docker images. Docker Hub is a public registry that anyone 
can use, and Docker is configured to look for images on Docker Hub by default. You 
can even run your own private registry. 

* When you use the docker pull or docker ru 
pulled from your configured registry. When yo 
image is pushed to your configured registry. 


| 4.2.1| Docker Architecture 


e Docker utilizes the client-server architecture and a remote API to manage and create 
Docker containers and images. i ; i 
e Docker containers are created from Docker images. 
e The relationship between containers and images are analogous to the relationship 
between objects and classes in object-oriented programming, where the image 
; describes the container, and the container is a running instance of the image. ` 
e The Doeken cieni talks bes the Docker daemon, which does the heavy lifting of building, 
_ _ running, and distributing your Docker containers 
e The Docker client and daemon can ru s 
f ; run on the same ; ta 
Docker client to a remote Docker daemon T ci an e 
e The Docker client and daemon com i 
' municate usin a 
network interface. Another Docker client ie en een NCS ae 
applications consisting of a set of containers 


n commands, the required images are 
u use the docker push command, your 


er Compose that lets you work with 


a7 Doc 
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5. Docker Objects: 

e When you use Docker, you are creating and using images, containers, networ 
volumes, plugins, and other objects. This section is a brief overview of some of thos. 
objects. Š 
(a) Images: ) 

o An image is a read-only template with instructions for creating a Docker 
container. Often, an image is based on another image, with some additional 
customization. For example, you may build an image which is based on the 
Ubuntu image, but install the Apache web server and your application, as Well as 
the configuration details needed to make your application run. 

o You might create your own images or you might only use those created by others 
and published in a registry. To build your own image, you create a Dockerfile with 
a simple syntax for defining the steps needed to create the image and run it. Each 
instruction in a Dockerfile creates a layer in the image. When you change the 
Dockerfile and rebuild the image, only those layers which have changed is rebuilt, 
This is part of what makes images so lightweight, small, and fast, when compared 
to other virtualization technologies. 

(b) Containers: 


o A container is a runnable instance of an image. You can create, start, stop, move, 
or delete a container using the Docker API or CLI. You can connect a container to 


one or more networks, attach storage to it, or even create a new image based on its 
current state. 


o By default, a container is relatively well isolated from other containers and its 
host machine. You can control how isolated a container’s network, storage, or 
other underlying subsystems are from other containers or from the host machine. 


o A ee is defined by its image as well as any configuration options you 
provide to it when you create or start it. When a container is removed, an 
changes to its state that are not stored in persistent storage disappear. 


Understanding the Docker Components 


Containers: 


e A Docker container image is a lightweight, standalone, executable package of 


software that includes everything needed 
to run icati : ime, 
system tools, system libraries, and settings, an application like code, runt 


Docker Image: 


These are the basis of contai i i 
ntainers. An image is an ordered collection of root filesyste™ 


changes and the corresponding i 
executio ES ; 
runtime. n parameters for use within a containe? 


e An image typically consists of a union of Ja 
other. 


e Animage does not have state and it never chan 
ges. 


yered file system stacked on top 0f each 
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ocker Hub: ooo Docker - Containers 
0 : 


This is a centralized resource for workin 
o Docker image hosting 

o User authentication 

o Automated images build and workflow tools s 
o Integration with Github and bitbucket, 


g with Docker and its components it provides: 


uch as build triggers and webhooks. 


pocker Registry: 


Registry is a hosted service containing repositori i 
$ ories 
registry API. š of ima 


Default registry can be accessed using the brow 
ser at Do : 
search command. cker hub or using the Docker 


ges which responds to the 


Repository: 


A repository is a set of Docker images the repository can be shared by pushing it to a 
registry server. 


The different images in the repository can be labeled using tags. 
INSTALLATION =- ia 
For Mac and Windows, there are a few different options for installing the Community 
Edition. The modern way to install Docker is to use Docker for Mac 
(https://www.docker.com/docker-mac) or Docker for Windows 


(https://www.docker.com/docker-windows) respectively. The installation includes the 
Docker platform, Command-line, Compose tools. 


[Note: Docker for Windows requires Windows 10 Professional or Enterprise 64-bit] 


Installation of Docker on Linux : 


For Linux, each distribution has a unique way of installing Docker, so it is 
recommended you visit https://docs.docker.com/engine/installation/ for specific 


installation instructions. 
Another way to install Docker on Ubuntu is to use the default Ubuntu repository. 


Open the terminal on Ubuntu and follow the below steps: 


.Step1 : Checkifthesystem is up-to-date using the following command: 


$ sudo apt-get update 
Step2 : Install Docker using the following command: 
$ sudo apt install docker.io 


Step 3 Install all the dependency packages using the following command: 
$ sudo snap install docker 
Step 4 Check Installation. 


roperly installed by running the status 


Check whether Docker was P see the Docker daemon 


command or checking the program version. To 
status, run: no 
tl status aoc , l I 
Aea ae eens check the version installed using the following 
command: 
$ docker -version 
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[4.3.2 Installation of Docker on Windows 


Docker info: This command dis 


la ida i i 
Docker installation. P IE N information regarding the 


Follow the below steps to install Docker on Windows: , 

Step1 : To download the docker file, go to the 
website https://docs.docker.com/docker-for-windows/install/ 
[Note: A 64-bit processor and 4GB system RAM are the hardware 
requirements to successfully run Docker on Windows'10.] 

Step2 : Now double-click on the Docker Desktop Installer.exe to run the 
installer. 
[Note: Suppose the installer (Docker Desktop Installer.exe) is not 
downloaded; you can get it from Docker Hub and run it whenever 
required.] ov 

Step3 : Once you start the installation process, always enable Hyper-V Windows 
feature on the Configuration page. 

Step4 : Follow the installation process to allow the installer and wait till the 


process is done. 
Step5 : ` After completion of the installation process, click on the Close and restart 
button i 
|4.3.3| Some Docker Commands 


Basic commands of Docker are: 
1. Docker Version: This command shows the Docker version information. 


$ docker version 


:\>docker version 

lient: 

Cloud integration: v1.6.24 
Version: 20.10.17 

API version: 1.41 

Go version: g01.17.11 
Git comit: 1090c701 
Built: Mon Jun 6.23:09:02 2022 
OS/Arch: - windows/amd64 
Context: default 
Experimental :. true 


Server: Docker Desktop 4.10.1 (82475) 
Engine: 
Version: 26,10.17 | 
API version: 1.41 (minimum version 1.12) 
Go version: gol.17.11 
Git commit: a89b842 
Built: Mon Jun 6 23:01:23 2022 
OS/Arch: linux/amd64 i 
Experimental: false 
containerd: 
version: 1.6.6 
GitCommit: 10¢12954828e7c7c9b6eGea9becO82b01407d3ae1 
runc: i 
Version: 1.1.2 
GitCommit: v1.1.2-0-ga916309 
docker-init: 
Version: 6.19.8 
GitCommit: de4Gad0 


Fig. 4.5 (a) 


I Fig. 4.5 (b) 
'3, Docker login: Login to a Docker registry. 
` $ docker login [options] [server] 
Log in to Docker hub registry by typing: 
.$ docker. login | 


C:\ydocker login : ear . A ' i Pa Ants 
Login with your Docker ID to push and pull images froa Docker Hub. If you don’t have a Occker ID, bead over t3 betys://had. cocker, creat 


Username: sheetalbhalgat 
Password: 
Login Succeeded 


count. > 
Logging in with your password grants your terminal cosplete access to your ac E P accéss-tokens! 
foe better aor fa hee in with-a lislted-peivilege personal access token. Learn more at https://cocs: com gol 


Fig. 4.5 (c) 

4. Docker logout: Log out from a Docker registry. 
$ docker logout 

5. Docker Search: Search the Docker Hub for images. 
$ docker search [options] Term 
Search image by ID: Below examp 
ubuntu’. 
$docker search ubuntu 


le displays images with a name containing 
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Fig. 4.5 (å) 
6: Docker Pull: Pull an image or a repository from a registry 
$ docker pull [options] Name[:Tag] t 
Pull an image from Docker Hub: To download a particular image, or set of images 
(Le., a repository), use Docker Pull. If no tag Ís provided, Docker Engine uses the 
: latest tag as a default. This command pulls the ubuntu:latest image: 
$ docker pull ubuntu 
C:\ddocker pull ubuntu 
Using default tag: latest 
latest: Pulling from \ibrary/ubuntu 
Zab@Sbe27e7F: Pull complete 
Digest: sha256:67211¢14fa74f@78d27ccS9d60a7 fadaetfBe2beal 18ef Ibabc29Sa0s 2Esh7) 
Status: Downloaded newer image for ubuntu: latest 
docker.io/library/ubuntu: latest 


Fig. 45 (e) 
7. Docker Push; Push an image or a repository to a registry, 
$docker push [OPTIONS] NAME[:TAG) 
C:\xéocker posh sheetalbhalgat/ubuntu 
Using default tag: latest 


The push refers te repository [docker.{o/sheetalthalgst/ubetu] 
tok 1bdBi2ad: Mounted from Mibrary/ubunty 


Latest: digest: shalS6 : 5513 F822G0589Sb0a 752 Mada der G44) 35721b031 freee TaScdaPda?@ecies size: 438 


Ç cheetatthaiggt / ubuntu 


lacey 
fe ensie Pe cio pes f 


` gdocker isages [OPTIONS] [REPOST : 

List the local server Docker imag ia or 
C:\>docker images 
REPOSITORY a TAGE ID CREATED 
ubuntu atest © 08422¢ced1s 7 wets 
gheetalbhalgat/ubuntu latest eadz2cecebis 7 weets a rie 
Fig. 4.5 (h) 
9, Docker Tag: Create a tag TARGET_IMAGE that refers to SOURCE_IMAGE. 

$ docker tag SOURCE_IMAGE[:TAG] TARGET_IMAGE[:TAG] 


Tag an image referenced by Name and Tag: To tag a local image with the name 
“ubuntu” and tag “latest” into the "sheetalbhalgat” repository with “latest”: 
$ docker tag ubuntu:latest sheetalbhalgat/ubuntu:latest 


How to do “hello world” in Docker? 
$docker run -it hello-world 
C ictor ee it bello rift 
patie ts fhad teage “nelto arid Istest’ lorally 
Latest: Polling free [lt-erytelio-wr}s 
SADT PL he Pall complete 
Digesto sarie Gat Ds hefed raed 91a SALIE cate eheti P Sertan 
States Cewe)nated sewer image for Rello-wrld latest 


welds teye Sorter! 
feis arssago Hews thet pour instal lotion appears to be wrting covertly 


ta generate This sertege, Darter tock the folloning stigs: 
Phe Cocter cilent comtaited tta Packer fremur. 
Tee Docter Gomme polled the "talls sorts tenge fros tre Dexter &3 


fom 
a or Goia roroi 9 cox itala frat Wal Langs wich reg ts 


apr an oid py ok malate Ae ag aia emt it 
ts pow tarairal. 
Ta try seething sore emitions, pay (3 oon os anta Cot einer wlth: 
f ába om ir ete Det 
ware baspri, samita ort! Lost, eed wore ttt a free tatar 
Betpas {hes Coker Coes 


for more examples sed idsi, visit: 
etra //bocs cocker com get strted! 


Fig. 4.5 (i) 
LEY] Provisioning 


* Provision a Docker host together 
following steps. 
1 Install Babun ' 
2. Instali VirtualBox (Here we use 5.0.18) 
3. Install Vagrant 


using Vagrant and Virtualbox on Windows using 


i Docker - 
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4. Openanew Babun shell window and create a directory for our vagrant box as 


follows: 

cd ~ && mkdir -p vagrant/trusty64 && cd vagrant/ 
Download the Vagrantfile for ubuntu (trusty 64-bit) 
vagrant init ubuntu/trusty64 
The Vagrantfile contains instructions for how Vagrant should build your virty 
machine. Open the Vagrantfile with your text editor of choice and find the following 
sections: 


trusty64 


# using a specific IP. 

# config.vm.network “private_network”, ip: “192.168.33.10”...# 
config.vm.provision “shell”, inline: <<-SHELL 

# sudo apt-get update i 

# sudo apt-get install -y apache2 

# SHELL 


Modify it so that Vagrant assigns the IP address “192.168.10.101” and installs Docker 
for us: 
# using a specific IP. 
` config.vm.network “private_network”, ip: 
192.168.10.101”...config.vm.provision “shell”, inline: <<-SHELL 
wget -qO- https://get.docker.com/ | sh 
SHELL 
After the edits, the file should look like so: 
# -*- mode: ruby -*' 
# vi: set ft=ruby: 
Vagrant.configure(2) do |config| 
config.vm.box “ubuntu/trusty64" 
config.vm.network “private_network", ip: "192.168.10.101" 
config.vm.provider "virtualbox" do |vb| 
vb.memory 
vb.cpus = 2 
end 
config.vm.provision "shell", inline: <<-SHELL 
wget -qQ- https: //get.docker.com/ | sh 
SHELL 
end 
Vagrantfile with comments removed (custom c 
Back in the Babun shell window, we can brin 
vagrant up 
Once the Vagrant box is ready, ssh to it: 
vagrant ssh 


pu/memory settings are optional). 
8 the virtual machine online by running: 
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, Now we can start running docker images using following 

„udo docker run -d -p 80:80 es £ tolowing command, 
ners rin our hosts file so it’s easi 
remember. kupen c: \windows\system32\drivers\etc\host that it’s easier to 
editor as administrator) and add the following line: eae as 
192.168.10.101 dockerbox 

. Save the changes to the hosts file, Open the br 

nttp:// dockerbox and you should see the nginx welcome p 


DOCKER HUB ; 


owser and navigate to 
age. 


e Docker Hub is S cloud-based repository in which Docker users and partners create, 
test, store and distribute container images. 

e Through Docker Hub, a user can access public, open source image repositories, as well 
as use a space to create their own private repositories, automated build functions, 
web hooks and work groups. 

e For example, a DevOps professional can download the official PostgreSQL object- 

_ relational database management system container image from Docker Hub to use in 
an application deployed in containers. Or, they can choose a customized RDBMS from 
their company's private repository. Following figure will clear idea of this: 


Container Engine 


m 
Jo 832 p 
000 

0000 Images Container 


Image-instance running 
an. app process 


< Static, Persisted 
Registry/Hub ` Container Image 


A registry stores many static images 


Container Engine 
Pa 
Container 


Image-instance running an app 
process in same system 


Images 
Static, Persisted 
Container Image 


Dockerfile 
all commands to 
assemble an image 


cker Hub 


Fig. 4.6: concept of Do 
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Features of Docker Hub: 


1 


2 


™, 


Docker - Containers 


Docker Hub simplifies the process of storing, managing, and sharing images With 


others. 
Docker Hub perform: 
complete report on the security issues. 


It automates processes such as Continuo 
by triggering Webhooks at the time of pushing the new image into Docker Hub. 


It allows us to manage the permissions of users, teams and organizations. 


s the necessary security checks on the images and proyj dese 


us Deployment and Continuous Testi 2 


4. 

5. We integrate Docker Hub with tools such as GitHub, Jenkins to streamline 
workflows. l 

Advantages of Docker Hub: 

1 Docker container images are lightweight and can be pushed in a matter of 
minutes using a command. 

2. Itis a safe method and also offers a feature such as pushing a private image ora 
public image. 

3. Docker hub is becoming more and more popular in industries and acts as a link 
between the development teams and the testing teams. 

4. If you want to share your code, software, or any kind of file for public use, you 


can just make the images public on the docker hub. 


Downloading Docker Images 


* To download a particular image, or set of images (i.e., a repository), use docker image 
pull (or the docker pull shorthand). 
Syntax: 


docker pull [OPTIONS] NAME[:TAG|@DIGEST] 


If no tag is provided, Docker Engine uses the: latest tag as a default. This example 


pulls the debian: latest image: 
Example: 

cocker image pull debian 

Using default tag: latest 

latest: Pulling from library/debian 
e756f3fdd6a3: Pull complete 


Digest :sha256:3f1dőc17773245c97bd8f15gd 
518 


Status: Downloaded newer image for deb 


665c9789d7b29ed7917ac934986ad96f92e4 


ian:latest 


docker. io/library/debian: latest 


Y 
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2| uploading the Images in Docker Registry and AWS ECS 


pe 


(o 


gre w is an example of how to create your o 


Uploading Docker Image in Docker Registry 


wn docker image on your local 
machine/server (not on the login or calculation node) and upload it to the Poblenou 


Registry Server. 


Compute cluster 


nodes Standalone/Swarm 


docker engine 


Fig. 4.7: Uploading Docker Image in Docker Registry 
You must know following things before start building a process: 


About the builder environment: 


o Docker engine and root access on your builder machine. 
o- Shell scripting skills. 
o Docker command line knowledge. 


About Registry Server: 


o You need a user to upload your image. e a 
o Access to the private network of Remote Server registry.sb.upfiedu. 


o Uploaded images can't be removed. 
o Uploaded images can be updated 


Process: 
Step1 : Create a directory to build the image. 
$ mkdir ubuntu-18.64 
$ cd ubuntu-18.04/ 
Step2 : Write a docker file with settings. 


$ vi Dockerfile 


FROM ubuntu:18.04 a 
MAINTAINER John Brown "https://reg 


LABEL authors="John Brown 


istry.sb. upf.edu" 


LABEL version="18.84" ee 
LAB s tion="Basic images wit F 
iia ae server nmap sudo telnet sssd installed 
\openssh- 


RUN apt-get update 


r NCR EE TE UE ee pevops- ; MCA [Management - Sem. I 4.18 
RUN apt-get install -y openssh-server nmap sudo telnet sssq step5 : Rename the image Pocket Container 
Change the RE 
RUN mkdir /var/run/ssh¢ P me : SEARCH_GROUP for the acronym of the re 
RUN echo ‘root: a $ docker tag <IMAGE_ID> SEE 
RUN sed -ri 's/*#?PermitRootlogt H registry.sb.upf.edu/<research 
/PermitRootLogin yes/'/etc/ssh/sshd -config $ docker tag 401153215cb6 -Broup_acronym>/ubuntu:18.04 
RUN sed -ri ‘s/UsePAM yes/ausePAN yes/g’ /etc/ssh/sshd_config 


Step3 : 


Step4 : 


RUN mkdir /root/.ssh 


RUN apt-get clean 8& \rn-rf/var/lib/apt/lists/* /tmp/* /var/tmp/* Step 6 : 
EXPOSE 22 , i 
CMD ["/usr/sbin/sshd", “-D" ] 

It is essential to add "LABEL authors" with your name, surname and email 

address. 

Build the image in a local docker-host 

$ docker build. ; 
Sending build-context to Docker daemon 2. 048kB Step7 : 
Step 1/12 : FROM ubuntu:18.04 

18.@4: Pulling from library/ubuntu 

a48cSe@@ed24e: Pull complete ; 

leideeeff7ei: Pull complete 
@33@ca45a200: Pull complete sal ae 
471db38bcfbf: Pull complete 

@b4ab2487617: Pull complete 
Digest: sha256: c8c275751219dadad8fa56b3ac41ca6cb22219ff117ca 

: 98fe82b42f24e1ba64e 

Status: Downloaded newer image for ubuntu:18.04 

---> 452a96d81c30 . 

Step 2/12 :, MAINTAINER John Brown "https://registry.sb.upf.edu" 

---> Running in 2fd5f8e83c17 

Removing intermediate container 2fd5f8e83c17 

---> b984d50d740c 
Step 3/12 : RUN apt-get update 

---> Running in 9c84731ef4ed 
List and Checki image. 
$ docker images 
REPOSITORY TAG IMAGE ID CREATED SIZE 

<none> <none> = 401153215cb6 25secondsago 335MP 


registry.sb.upf.edu/mygroup/ubuntu:18,04 
[Note : Use lowercase in research prov 
List and check re-tagger image. gToup_acronym] 
'$ docker images 


REPOSITORY 


TAG IMAGE ID CREATED SIZE 
registry.sb. F 
upf.edu/mygroup/ outa 
p ae p 18.04 401153215cb6 minute ago 335MB 


Provide Credentials to establish a session with the corporate registry 
server. 

$ docker login registry.sb.upf.edu 

Username (): jbrown 

Password: 


Login Succeeded 


Push the image. 
$ docker push registry- sb.upf.edu/mygroup/ubuntu: 218.64 


` The push refers to repository [registry.sb-upf. edu/info/ubuntu] 


68d59e996e14: Pushed 
b191e5e42292: Pushed 


- dcb7bc3f07ca: Pushed 


ffc69fc3fb3e: Pushed 
‘401b721534a1: Pushed- 
a1355d87070f: Pushed 
b337788c3f94: Pushed 
a4d6cb1434aa: Pushed 
os59ad60bcacf: Pushed 
8db5f072feec: Pushed 


67885e448177: pushed 
ec75999a0cb1: pushed 
65bdd50ee76a: pushed 


18.04: digest: 
sha256:54567 7b1dc80 


cf89e2 size: 3025 


Cc e 
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suOA taan a oou Packet Container, props: | 

: | Sen authenticating to multiple registries oie Docker - Containers 
StepS : Check the image in 


; it. edu! 
L Gotohttps://registry.sb.upf.& 


2 Login with your duster credentials. 


P a wim Erand 4 
Docker Registry Hronieng 


aws ecr get-login-passworg -region region | docker 
login --usernase AWS <-p3ssword-stdin 
aws_account 


1d .dkr ecr region. amazcnaws.com 
step2 :! If your image repository doesn't exist in the 
yet, create it. 


step3 : Identify the local image to push. 
Run the docker images command to list the container images on your 
system. 
docker images 
You can identify an image with the recositsry-tag value or the image ID 
in the resulting command cutput 
Step4 : Tag your image with the Amazon ECR registry, repository, and 
optional image tag name combinaticn to use. 
The registry format is aws_account_jd. dic. ect-us-west-2amazonaws.com. 
The repository name should match the repository that you created for 
Fig. 4.8 your image. If you omit the image tag, we assume that the tag is latest. 
Stepi0: Convert Docker image to singularity image Example: The folowing example tags a local image with the ID 
Finally, if we have uploaded a Docker image, it will be necessary to convert e9ae3c220b23 2s aws_account_id dir ecr-us-west-Lamazonaws.com/my- 
the file format (from OCI to SIF). You can do it directly from compute 


Weni Hee Aer Sh oe 


registry you intend to push to 
Details for repository: info/centos 


E Creted Raster © Docker version 


2 repository:tag- F: Poet 

$ á p / docker tag e9ae3c2206233 aws. fy 

€ mej user 
; : i 2.amazonaws.com/my- F 
S singularity pull —docker-login docker://registry.sb.upf.edu/<research- ; ing the decker push command. 
š Step5 : Push the imagecsizg ny com/my- 
7 group>/<im2ge> < docker push aws_account_id dicecr.us-west-2 2 azonaws. 

Uploading Docker Image in AWS ECS repository:tag 
e The Amaron ECR repository must exist before you push the image. Amazon ECR also Step 6 (Optional): 


provides a way to replicate your images to other repositories, across Regions in own 


zi à a ; ae rent accounts, by specifying a replication configuration in 
your private registry settings. 


: those tags to 
Apply any additional tags to your image and Push 

a Amazon ECR by repeating Step 4 and Step 

4.4.3 | Understanding the Containers 


Step : Authenticate your Docker client to the Amazon ECR registry to which you 
intend to push your image. 
Authentication tokens must be obtained fo r 
nd the 
ii E r each registry used, a 


oe noe ee zon ECR registry, run the aws ecr get 
E logi E When passing the authentication token t° 
specify ie Paes ne » use the value AWS for the username and 

registry URI you want to authenticate to f 


A container is a sandboxed process running OS® 
all other processes running 02 that host 
namespaces and cgroupsopen_in_new. 
time. Docker makes these capabilities 3PP am 
A container is a runnable instance pa eee can 
delete a container using the Docker API or a eit 
More networks, attach storage t° eee 

State, 


Docker « Conta; 
— Det 


a2t 
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; defaul iner is relatively well isolated from othe narra S host 
a ee = ee greene how isolated a container's nae i $ rag s OF Other 
machine. You can J yost machine, 
underlying subsystems are from other containers or from the 


tion options you proyj 
n b r 7 N as any configura v de 
container is defined by its image as we ; 

‘4 it when rei create or uk it, When a container Is removed, any changes to its State 
that aren't stored in persistent storage disappeaT. 


4.4.4] Running commands in Container 


How does the docker run command work? 
© The following command rans an ubuntu container, 
local command-line session, and runs /bin/bash. 

$ docker run -i -t ubuntu /bin/bash : ; 

e When you run this command, the following happens (assuming you are using the 
default registry configuration): 

1 If you do not have the ubuntu image locally, Docker pulls it from your configured 
registry, as though you had run docker pull ubuntu manually. 

2. Docker creates a new container, as though you had run a docker container create 
command manually. 

3. Docker allocates a read-write filesystem to the container, as its final layer. This 
allows a running container to create or modify files and directories in its local 
filesystem. 

4. Docker creates a network interface to connect the container to the default 
network, since you didn't specify any networking options. This includes assigning 
an IP address to the container. By default, containers can connect to external 
networks using the host machine's network connection. 

S. Docker sans the container and executes /bin/bash. Because the container is 
running rerictiveiy and attached to your terminal (due to the -i and -t flags), 
3 can provide input using keyboard while Docker logs the output to your 

6. When you run exit to terminate the /din/bash com 
is not removed. You can start it again or remove it. 


Running Multiple Containers 


e With Docker compose, you can confi : 
yanal file. ‘gure and start multiple containers with a single 


attaches interactively to your 


mand, the container stops but 


pockerfile, Images, and Containers: 
» Dockerfile, Docker Images, and Docker Containers are three i SENSI PEA 


; MCA [Mana ament - Sem. 42 
TS EAEE 


pow 


does Docker Compose work? 


ker compose is a yaml file in which we ca 
net with a single command all containers aa te hina “ai of services. 
qhere are three main steps Involved in using compose: 
o Generatea Dockerfile for each Project. 
setup services in the docker-compose.yal file. 


Fire up the containers. 


CUSTOM IMAGES 


oO 


(0) 


need to understand while using Docker. 


Build Run 


Docker File Docker Image Docker Cortamer 
Fig. 4.9: Docker file, Images, and Containers 


e Asyoucan seein the above diagram when the Deckerfile is built, it becomes a Docker 


image, and when we run the Docker image then it finally becomes a Docker container. 
(a) Dockerfile: A Dockerfile is a text document that contains all the commands tata 
user can call on the command line to assemble an image So, Docker can build 
images automatically by reading the izsuuctors from a Deckerfile. You can = 
docker build to create an automated build to execute several command-line 
instructions in succession. eae 
(b) Docker Image: In Layman's terms, a Docker image an be compare mer 
that is used to create Docker containers. So, these read-only templates a 
building blocks of a Decker container. You can ese docker bF P AAR 
the image and create a container. PAR Ase 
Registry. It can be either a user's local se Sampak = ipse i ames = 
` Docker hub which allows multiple users to colaborate in building an ape 


Docke tainer i running instance ê a Docker image as 
GESi atin see : the application. 5 — are basically 
they hold the entire package needed to ss ne as p SE EE 
the ready applications created from Docker imag ultimate 
neues i mized docker image is 
Į erter an our gti Ba i a 
created. This customized docker image In 


tainer. 
Packages and copy the code into the docker con 


(c 


— 
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Requirements to create Custom images are aS follows: 
© Webdock cloud Ubuntu instance (18.04 or later) 
o You have shell (SSH) access to your server 

Docker installed on Ubuntu instance 

Clone of a demo node.js project 


Creating a Custom Image 


Step1 : Writing Dockerfile for custom docker image. 
Docker builds the docker image by reading the instructions from a text file. By 


(e) 


° 


Dockerfile Instructions: 


2. WORKDIR instruction: 


Docker - Containers 


default Docker looks for a file named Dockerfile to build the docker image. The 
Dockerfile consists of instructions that are used to customize the docker image. 
We will write a Dockerfile for a node.js application. For this, first go to the root 
directory of a node.js project. J 

$ cd node-app 
Create a Dockerfile using the following command in the terminal. 

$ touch Dockerfile 
Open the Dockerfile in your favorite editor. 

` $ nano Dockerfile 


Format of Dockerfile instruction: 

INSTRUCTION arguments 3 
The instructions in Dockerfile are not case sensitive but it is convention to use 
UPPERCASE letters for instructions. Dockerfile builds the docker image by 
running the instructions in the order they are specified in Dockerfile. 
1. FROM Instruction: i 


A Dockerfile always starts from a FROM instruction which specifies which 
base image will be used to create the custom docker image. For example, if 


you want to create a custom docker- image for node.js application, then the 
node base image will be used as follows. 


FROM node:14 


If you do not specify a version tag, by default it will use the node image with 


the latest tag. The base docker image will be pulled from DockerHub if it s 
not available locally. 


Dockerfile provides WORKDIR instruction to set the working directory. 
WORKDIR /app 


The above instructi i 
ee ae ction will set the working directory to /app inside t 
. remaining instructions will be executed in this directo} 


A agement - k 
povo s : MCA [Man sem 4.24 | 
ADD or COPY instruction: Docker - Containers 


3. 


; container at runtime, use 


The following table contains th 


explanation. 


‘/bin/sh -c. 


in 
host and web as well. struction can copy data from docker 
Copy the source code into the dock 
er i ; ; 
as follows: l ; container using the COPY instruction 
COPY .. 


This instruction will copy all the data from the working directory of the 
docker host to the working directory of the docker container. 


RUN instruction: 
The RUN instruction is used to install new packages or run some shell 
commands in the base docker image. For example, in order to install npm 
packages, the RUN instruction will be used as follows: i 

RUN npm install 
The RUN instruction will run the command in the shell of the docker 
container. l 


` EXPOSE instruction: 


The EXPOSE instruction is used to expose a port of a container. The port on 


‘which the application runs can be exposed using the EXPOSE instruction as 


follows: | 

EXPOSE 3000 
Now the application running on po 
accessible from docker host when a con 
image. 
CMD and ENTRYPOINT instructions: 
The CMD and ENTRYPOINT instructions 
commands inside the docker container when aes 


rt 3000 of the docker container will be 
tainer is launched using this docker 


are used to execute the shell 
the docker container starts. 


ed to the 
While the CMD instruction is used to define the arguments pass 
ile the 
shell command. 


In order to run the /b 


in/sh c node index.js command inside the docker 
‘ 3 . . 
the following CMD instruction. 


» «jndex-js”] d their 


cmp [“node”, important rfile instructions an 
ei 


Docke 


Docker - Conta 
Ner 
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Table 4.2: Dockerfile Instructions 
[FRM O Sets the base image for subsequent instructions. 


Sets the author field of the generated images. 


Executes commands in a new layer on top of the current image 
and commits the results. 


Allowed only once (if many, then only the last one takes effect), ` 


Adds metadata to an image. 


Informs Docker that the container listens on the Specified 
network ports at runtime. 


Sets an environment variable. 


Copies new files, directories or remote file URLs into the 
filesystem of the container. 


COPY | Copies new files or directories into the filesystem of the container, 
ENTRYPOINT Allows you to configure a container that will run as an executable, 
VOLUME 


Creates a mount point and marks it as holding externally mounted 
volumes from native host or other containers. 


USER Sets the username or UID to use when running an image. 


Sets the working directo 
and ADD commands. 


Defines a variable that users can 


Pass at build time to the builder 
using buildarg. : 


Adds an instruction to be ex 
as the base for another build. 
Example 1: The final Dockerfile is: 

FROM node:14 

WORKDIR /app 

COPY . 


ecuted later, when the image is used 


RUN npm install 
EXPOSE 3089 
CMD [“node”, “index. js” 
Step2 : Create docker image from Dockerfile 


After writing Dockerfile, no 
build the docker image from 


$ docker build 


w run the followin co : 7 
m al to 
Dockerfile, 8 command in the termin 


Le _— 


ry for any RUN, CMD, ENTRYPOINT, COPY, | > 


build the docker image. 


In order to build the docker image fro 
the directory containing Dockerfile, 

$ docker build /home/$USER/ 
This command will get the Dockerfile fr 


docker image om /home/$USER directory and build 
the doc : 


To build a docker image from a file nam 


; ed other than Dockerfile, specify the 
Dockerfile name using the -f option. 


$ docker build -f Dockerfile.dey /home/$USER/ 
The above command will build the docker image by reading instructions from 
Dockerfile.dev file in /home/SUSER directory. 


Each docker image created using the build command gets a unique ID and all 


Step3 : 


the docker images with their IDs can be listed using the following command. 
$ docker images 


Tag docker image 


.The docker image built using the commands described in the previous section 
does not have a name and tag. Docker tags are helpful to push the docker image 
to a remote docker repository and specify the docker image version. 

Use the following command to tag the docker image. 
$ docker tag 21233 node-app:v1 


- The above command will take a docker image with ID 21233 and add a tag node- 


Step 4: 


app:v1 toit. 


„Use the following command to list all the docker images with tags. 

$ docker images. pe 
Push docker image to DockerHub 5 — 
In order to push the docker image to DockerHub or x one To 
repository, the docker image must be tagged ae rubble ust be tagged as 
docker image to a docker hub repository, the ž 
follows. 

example/node-app:v1 ee is the docker hub 
Where eae is the docker hub sees ap eie A command to tag 
repository and v1 is the docker image tag. Use the S 
the docker image. 

$ docker tag 212233 ee you must log into the docker 
Before pushing the docker image to docker ub, Yon tolog into docker hub. 
hub ce command line. Use the following comm 


$ docker login 


Docker « Container, 
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It will ask for docker hub username and password. Siege USe the 
following command to push the docker image to docke : 


$ docker push example/node-app:v1 


4.5.2 Running a Container from the Custom Image 


Running Docker image using docker run command: 

* The docker run command first creates a writeable container layer over the Specified 
image and then starts it using the specified command. 
$ docker run [OPTIONS] IMAGE [COMMAND] [ARG...] 
Example: 
Assign a name and allocate pseudo -TTY(- -name, -it) 
This example runs a container named ubuntu-container using the ubuntu:latest 
image. The -it means interactive terminal and --name specifies the name of the 
container. It instructs Docker to allocate a pseudo-TTY connected to the container’s 
stdin. It creates an interactive bash shell in the container. 

$ docker run --name ubuntu-container -it ubuntu 


C:\temp>docker run --name ubuntu-container -it ubuntu 
rooteéafd838c16e3:/¢ 


Fig. 4.10 
4.5.3 | Publishing the Custom Image 


. To publish custom image, user will need to create an account on the Docker Hub 
signup webpage. Here user will provide a name, password, and email address for his 
account. 

. n ae Lae isan ae account, he can push the image that he has previously 
crea to make it available for others to use To do so, user will 

. , need the 1D and the 
TAG of “my-docker-whale” image. : 


e Run again the "docker images" command and note th , i 
ID 
image e.g. a69f3f5e1231. e ID and the TAG of his Docker 


of data (in our example). Once 


it has completed, user can go to his Profile on Docker Hub and check out his 
new 


image. 
Docker Container Commands 
Listing Docker Container; 
pocker ps: This command displays the list of containers, 
$ docker ps [OPTIONS] 


show both running and stopped containers: The docker ps command only shows 
running containers by default. To see all containers, use the -a option. 
$ docker ps -a 


C:\tespodocker ps -3 
CONTAINER ID IMAGE Cowan OUSTED STENS RS 


(o) 


6afć338c1ée3 ubuntu «= “/BLn/bach” est a aista ap bios (9) Rost s ama ap ort coin 


Fig. 4.11 
(b) Stop Docker Container: Stop one or more running containers. The main process 
inside the container will receive SIGTERM, and after a grace period, SIGKILL 
$ docker stop [OPTIONS] CONTAINER [CONTAINER...]} 
Stop a running container by using following command: 
$ docker stop ubuntu-container 
(c) Start Docker Container: Start one or more stopped containers. 
$ docker start [OPTIONS] CONTAINER [CONTAINER...] 
Start a stopped container by using following command: 
$ docker start ubuntu-container 
(d) Restart Docker Container: Restart one or more containers. 
$ docker restart [OPTIONS] CONTAINER [CONTAINER...] 
Restart a Docker container by using following command: 
_ $ docker restart ubuntu-container 
(€) Remove Docker Images: 
Docker rmi: Remove one or more images. 
$ docker rmi [OPTIONS] IMAGE [IMAGE 
Remove a Docker image by id: Below exam 
by id, . 
$ docker rmi b4f2cd35d4d4 


C:\temp>docker rai Moa E latest S 
U : halgat/ubuntu: BeN 
Del de enna aE aee eeceTsetd Fiant FLSD1eD 


Fig. 4.12 


ssel ; 
ple shows how to remove a Docker image 


bas74ccS3ze7F4 
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KJ] DOCKER NETWORKING 


Introduction 


e First we should understand the Workflow of Docker. 


‘Samm 


Project code 


[Container |< 


Container 


Docker 
container 


Fig. 4.13: The Workflow of Docker 

e .As you can see in the above diagram, a developer writes a code that stipulate 
application requirements or the dependencies in an easy to write Docker File and this 
Docker File produces Docker Images. So, whatever dependencies are required for a 
particular application are present in this image. 7 

e Now, Docker Containers are nothing but the runtime instance of Docker Image. Thesé 
images are uploaded onto the Docker Hub (Git repository for Docker Images) which 
contains public/private repositories. ; ; 

e From public repositories, you can pull your image as well and can upload own images 
onto the Docker Hub. Then, from Docker Hub, various teams such as Quality Assurance 
or Production teams will pull that image and prepare their own containers. These 
individual containers communicate with each other through a network to perform the 
required actions, and this is nothing but Docker Networking. - i 

e So, you can define Docker Networking as'a communication passage through which all 
the isolated containers communicate with each other in various situations to perform 
the required actions. 


Goals of Docker Networking 
(i) Flexibility: Docker provides flexibility by enabling any number of a ications o 
various platforms to communicate with each other. ja 

(ii) Cross-platform: Docker can be easily used in cross 
various servers with the help of Docker Swarm Clu 

(iii) Scalability: Docker is a fully distributed n 
grow and scale individually while ensuring 


-platform which works across : 
sters. 

etwork, which enables applications t° ` 
performance. 
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Kag | Flexibility 


User-Friendly 


Fig. 4.14: Goals of Docker Networking 
(iv) Decentralized: Docker uses a decentralized network, which enables the capability 
to have the applications spread and highly available. In the event that a container 
or a host is suddenly missing from your pool of resources, you can either bring up 
an additional resource or pass over to services that are still available. 
(v) User-friendly: Docker makes it easy to automate the deployment of services, 
making them easy to use in day-to-day life. 


the-box support. So, the ability to use Docker 


i) Support: Docker offers out-of- ; 
ee the functionality very easy and straightforward 


Enterprise Edition and get all of 
makes Docker platform very easy to use. 


4.6.1.2 | Types of Docker Networks 


* - There are various kinds of Docker networks such as: 


Bridge Network 
Host Network — 
None Network 
- MACVLAN and IPVLAN Networks 
o Overlay Network 
Default Bridge Network: 


° After a fresh Docker installation, cok 
running. We can see it by typ!N& $ doc 


O Oo Ọ © 


bridge network up and 


find a default 
etwork 1s 


you can 


c:\>docker a 


K ID A y 
NE Ma poag6bd bridge nE i 
3c92f1df3722 ar ees eal 
oc 
TNT e minikube bridge 
91818d219a re null 


bb49e3af8606 . 
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e All Docker installations have this network. If you run a container, say, Nginx, it Will be 
attached by default to the bridge network: 
$ docker run -dit -name nginx nginx: latest 
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: Docker . 
we can understand that Containers running on the same bri Containers 
' i each other using their IP addresses, On the e bridge ne 


: he other h twork are able to 
goes not support automatic service discovery, and, the default bridge network 


defined Bridge Networks: 


e By using the "inspect" command, you can check the containers running inside a yser- TE l 
network: ysing the i fe s possible to create other networks. You can create a d 
3 etwor : secon 
$ docker network inspect bridge bridge n 


docker network create my_bridge --driver bridge 

Now; attach “pusybox1" and "busybox2" to the same network: 
docker network connect my_bridge busybox1 
‘docker network connect my_bridge busybox2 

` Retry pinging "busybox1" using its name: 
docker exec -it busybox2 ping busybox1 


“ConfigOnly”: false, 
“Containers”: { s 
-oc7ecgbd3a76254eaba4Se1fb9c554d0a3695387c6216aeead6c1b49e463b729 sf 
“Name”: “nginx”, 
“EndpointID": -3aaf906898e38929f0344578c474acd7bc48d574cf9ab7eB304e240b1ba37cfe" 
“HacAdáress”: "02:42:ac:11:00:05", 
“IPv4address”: 7172.17.0.4/16", 
“IPv6Address": "7 


PING busybox1(172.20.0.2):56 data bytes 
“64 bytes from 172.20.0.2: seq=@ ttl=64 time=0.113 ms 

. We can conclude that only. user-defined bridge networks support automatic service 

discovery. If you need to use service discovery with containers then don't use the , 

default bridge, create a new one. ` 

Accessing Containers 

° “To access the containers, follow the steps given below: 

4, Obtain the container ID by running the following command: 

docker ps 

You can see the following output: 


Fig. 4.15 (b) 
e Docker uses a software-based bridge network. This network allows containers 
connected to the same bridge network to communicate while isolating them from 
other containers not running in the same bridge network. ; 


Let us see how containers running in the same bridge network can connect to each 
other. Let us create two containers for testing purposes: 


$ docker run -dit --name busybox1 busybox 
$ docker run -dit --name busyboxZ busybox 
e These are the IP addresses of our containers: 


$ docker inspect busybox1 | jq-r' [@].NetworkSettings.IPAddress' 


NAMES so 
j ' NERTID 
$ docker inspect busybox2 | jq-r'.[@].NetworkSettings.IPAddress' CONTATNE 
eee i serr sss & OGG: 
172.17.0.2 © |" IESE is) wa-con 
992.317.0021 ©» «we Se a a, kékwll 


Let us try to ping a container from another one using one of these IP addresses. For Fig. 4.16 


example, ping the container named "busybox1" from "bu u i its IP ‘ lowin command: 
nee iil nas i 2. Access the Docker container by running the fol £ 
Docker exec-it busybox2 ping 172.17.0.3 /bash 


docker exec -it <container_id> /bin 
-: Where, j 
container_id: This is the I 
explained in the first step, for exam 
inki i i linked 
UE inkin Containers . . vie containers to be 

Dock . f a linking system that allow ea to be sent from a source 

er consists of a unn 


together. This linking system cgi c 
container to a recipient container. 


PING 172.17.0.3(172.17.0.3):56 databytes 


64 bytes from 172.17.0.3: seq=0 ttl=64 time=0.245 ms 
e So, containers on the same bridge can see each: other usi 
happen if use the containers' name instead of the IP? 
docker exec -it busybox2 ping busybox1 


i i mand 
D of the container obtained with the com 
ple b0o2459af2b9c. 


ng their IPs. What wi 


onnection inform 


ping: bad address 'busybox1' 


DevOps : MCA [Management - Sem. | 4.33 


Docker consists of a - link legacy feature that enables two containers to be linke 


an other. Once a connection has been est 
e shared betwe zo containers. i 
Docker nee Wee allows the recipient container to get Connection 
information relating to the source container. 

Although Docker shiner eter a Docker networking 2 feature that enhances 
communication between containers, container linking is still in use. 
It is important to understand container linking since Ìt 1$ a resourceful alternative to 
networking. . 
Container linking is not limited to two containers. It can be applied to as many 
containers as possible. Chi : 

The linking system can establish a link of multiple containers to enhance 
communication between them. 


Exposing Container Ports 


ablished, the connection information can 


There are two ways to handle ports in Docker: Exposing the ports and Publishing the 


ports. 

1. Exposing a port means allowing others to know on which port the containerized 
application is going to be listening on, or accepting connections on. This is for 
communicating with other containers, not with the outside world. 

2. Publishing a port is more like mapping the ports of a container with ports of the 
host. This way, the container is able to communicate with external systems, the 


real world, and the internet. 
Container word 


Outside world 


Fig. 4.17: Exposing Container Port in Docker 
In the above figure, you will see how the SERVER container's port 80 is mapped to the 
port 80 of the host system. This way, the container is able to communicate to the 
outside world using the public IP address of the host system. 


On the other hand, the exposed ports cannot be accessed directly from outside the 
container world. - 


Remember the following points: 


o Exposed ports are used for internal c 
container world. 

o Published ports are used for commun 
world. 


ontainer communication, within the 


icated with systems outside the containe! 


Docker - Containg, 
8 


d to 


it is not necessary j expose a port because Most of 
setup already have a "default port" exposed in their confi ; 
qhere are two ways to expose a port: Iguration, 
4, using the EXPOSE Dockerfile instruction. 
2, using --expose with docker CLI or expose ke 
Let us see details of each method, 

d1: Via Docker file: 


the Docker ima 


ges Used in your 


e 
metho : Het oe 
you can add a simple instruction in your Dockerfile 


your application will be accepting connections on, 
About this instruction, you must know the following things: 
EXPOSE does not add additional layers to the 
‘metadata. 


“o EXPOSE is a way of documenting your application port. The only effect it has i 
terms of readability or understanding the application. y it has is in 


to let others know at which port 


(0) 


resulting docker image. It just adds 


. e You can see how expose works with a simple container image that has built just for 


this purpose. This image doesn't do anything. 
e Pullthe image. 
docker pull debdutdeb/expose-demo:v1 
This image exposes a total of four ports. List the image using the following command. 
docker image ls --filter=reference=debdutdeb/expose-demo:v1 
e Ifyou look at SIZE column, you will see that it is 0 bytes. 
docker image ls - -filter=reference=debdutdeb/expose-cemo:v1 
REPOSITORY TAG IMAGE ID CREATED SIZE 
= eB 
; - vi ad3d8tfaSbfe N/A 
debdutdeb/expose iets been z ER 
* The reason is simple. This image does not have any p expose instru 
added to this image are metadata, there are no actual layers. 


ri: í : ollowing command: 
* You can also get the number of available layers using nae ie we Jexpose-deno:v1 
docker image inspect -f ‘{{len RootFS.Layers}}" de 


° You n output like this: ; deb/expose- 
ns ec ae -f ‘{{len _RootFS-Layers}}" debdutde 
demo:v1 @ abe. 

Method 2 : Via CLI or docker compose: t to add an extra EXPOSE instruction in 

* Sometimes application developers eres 1) can detect the 

their Dockerfile h the Docker API) can ¢ t 
tainers (through t art of the deploymen 

* In e sure other con™ -build, as P 

ae E can expose multiple ports ai 
port in use easily, you the declarative method, 
process, method, i.e- the CLI, or 

* You can either select the imperative 

1.€. compose files. 
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(a) CLI Method: ve to do is use the « 
i iner, all you have to a ET. 
In this method, while creating a container, ab) 
. pine = y times as needed) with the port number and optionally th, 


protocol with a /. 
Example: 
cocker container run \ 
--expose 80 \ 
--expose S@ \ 
--expose 7@/udp \ 
-d --name port-expose busybox:latest sleep id 
Here, by default the busybox image doesn't expose any ports. 
(b) Compose file Method: 
* If you are using a compose file, you can add an array expose in the service 
definition. You can convert the previous deployment to a compose file like so: 
version: °3.7° 
services: 
PortExpose: 
image: busybox 
command: sleep id 
container_name: port-expose 
expose: 
- £ 
- 98 
- 7@/udp 


Once you have the container running, just like before you can inspect it- to know 
which ports are being exposed. The command looks similar. 


cocker container inspect -f \ 


“{{range Sexposed, $_ := -NetworkSettings.Ports}} 
{{printf “Xs\n" Sexposed}}{{end}}’ 4 
port-expose 


Sample Output: 
docker container inspect -f ‘ 
ra 
-NetworkSettings .Ports}}{{print¢ “R s\n" {{range 
78/udp 
86/tcp 


98/tcp 


$exposed, » eee 
Sexposed}}{{end}}' port-expose 


Se 
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er Doctar 
gfi container Routing Containers 
sre are three steps for Container Routing; 
custom Docker network named such that Docker 
aking it the default route. adds it to the container first, 
An IP tables rule to mark packets coming 
: policy-based routing on the host to route 
interface. 
prample of code: 
g create a new Docker-managed, bridged connection 
g 'avpn' because docker chooses the default route alphab 
pocKER_SUBNET="172.57.0.0/16" 
docker network . create --Subnet=$0CCKER_SUBNET -q 
com.docker .network.bridge.name=docker_vwpn avon 


g mark packets from the docker_vpn interface during prerouting, to destine 
them for non-default routing decisicns 


g @x25 is arbitrary, any hex (int mask) sheuld work 

firewall-cmd --permanent --direct --add-rule ipv4 sangle PREROUTING @ -i 
docker_vpn ! -d $DOCKER_SUBNET -j MARK --set-mark 2x25 

# alternatively, for regular iptables: 
#iptables -t mangle -I PREROUTING @ 
MARK --set-mark 0x25` 


i th 
1 
Gut of that Docker network. 

marked packets through the non-default 


etically 


bridge -0 


-i docker_von ! -d SDOCKER_SUBNET -j 


# create new routing table - 1¢@ is arbitrary, any integer 1-252 
echo "100 vpn" >> /etc/iproute2/rt_tables 


` # configure rules for when to route packets using the new table 
ip rule add from all fwmark @x2S lockup ven 


+ ble 
# setup a different default route om the new routing = ee 
# this route can differ from the normal routing table's 


ip route add default via 10.17.0.1 dev tund 


® connect the docker_vpn 
_docker network connect docker_vpr mycontainer 


tion's anaging an application's 

* One common challenge for DevOps aita mep development 
dependencies and technology stack pei they must keep the application 
environments. As part of their routine t x i ing platform that it runs on. On 
Operational and stable regardless of uain pea new features and ppan 
the other hand, Development teams geya application's stability by deploying 
Unfortunately, these often compromise 


: ent bugs. 
codes that introduce environment-depend 
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ganizations are increasingly adopting ; 
g a stable framework without 
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e To avoid this inefficiency, OTS oer 
containerized framework that allows designin 
adding: 

o Complexities 

o Security vulnerabilities 
Operational loose ends rae 
Containerization is the process of packaging an application’s code with 
dependencies, libraries, and configuration files that the application Needs to 
launch and operate efficiently into a standalone executable unit. S 
Initially, containers didn’t gain much prominence, mostly due to usability issues. 
However, since Docker entered the scene by addressing these challenges, 


containers have become practically mainstream. 
Check Your Understanding; 


L Who introduced the Docker? 
(a) Linus Torvalds, Mark Zuckerberg and Brendan Eich 
(b) Kamel Founadi, Solomon Hykes, and Sebastien Pahl 
(c) Brendan Eich, Sebastien Pahl and Greg Duffy 
(d) Mike Cagney, Suhail Doshi and Chris Wanstrath 
2. Which Markup Language is used to write Docker configuration files? 


O 


(a) XML (b) YAML 
(c) DHTML (d) JSON 
3. Which programming language is used to write Docker? 
(2) GO (b) .NET 
(c) C+ (d) C 
4. is instances of Docker images that can be run using the Docker run 
command. 
(a) File (b) Hub 
(c) Container (d) Cloud 
5. bcos Beu nd, you can see all the commands that were run with an image viaa 
(a) history (b) ref 
(c) -a (d) hist 
4. os is the era advantage of using Docker? : 
a proved application securi icati 
(c) Improved application a A i ATE eee performance 
7. What port does Docker registry use? Perana Scalability 


(a) Port 3000 
(c) Port 8000 


(b) PortSoo0 
(d) Port 6000 


$0 


How many private repositories ar oe : 
is e TE for the individual on Docker hub? 
(c) 7 . (à) 1 
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which of the following is not a container-based alternative to Dock 
ocker? 


a e R (b) CoreOs’rkt 
Canonical’s a) wi 
: S in bE (d) Windows Server Containers 
: (a) a butler (b) a sailboat 
(c) an octocat (d) a whale 


Answers 
3. 4. 5. 
7H 120 [3 | 40 | 50 | 40126 [s@ [sem 
practice Questions 
a a a 
gl Answer the following questions in short. 
l What is docker? 


What is the use of docker? 
State the various components of docker architecture. 


1. 


What is image in the docker? 
What are containers? 
What is the docker hub? 
What is the docker container? 
Which command is used to see the docker version? 
. State the command used to search the docker hub for images. 
10. Which command is used to pull an image or repository from a registry? 
11. What is the docker tag? 
12. Which command is used to restart the docker container? 
QI Answer the following questions. 
How does docker work? 
Write down use cases of docker. 
Differentiate between Docker vs Virtual Machines. 
Explain docker architecture with diagram. i 
Explain the working of the docker run command. 
Explain various commands used in the docker tag. 
How to create custom images in the docker? 
Which are various arguments of the docker file instru 
- Explain workflow of the docker. a 
10. What are goals of the docker networking: ee 
1L Explain various commands used in the docker ne 9 
QU Write short notes on: 


pon aun p wy 


ction? 


WON ANAWN BP 


L Docker Container Linking. ann 


2. Docker Architecture. 


D... 


Build Tool - Maven 


Objectives... 


` After learning this chapter you will be able to: : 
@ Understand uses of Maven for Simple project setup that follows best practices, 


Œ) Understand the installation and uses of Maven. 


INTRODUCTION j 

e Maven is a popular open-source build tool developed b ; 
publish, and deploy several projects at once for better project management. 

e Maven is a project management and com 
complete build lifecycle framework. 

* Project requirements can be built automa 


phase. 

Functions of Maven: 
e Maven provides ways to developers to manage the following : 

Builds 

Documentation 

Reporting 
- Dependencies 

SCMs 

Releases 

Distribution 


[e] 
[e] 
o 
(e) 
° 
[e] 
° 
[e] 


5.2.1 Installing Maven on Windows 


e To install Maven on Windows, you need to 
1. Download Maven and extract it: 


y the Apache Group to build, 
prehension tool that provides developers a 
tically by Maven. Maven also can be helpful 


in collaborative work environment. Developer life becomes easy when Maven is used 
for project automation thus will be helpful for report creation, checks and testing 


5.2 
Build Tool - Maven 


Da wnload latest Maven software from Website ‘Maven - Download Apache Maven’ 


b display: 


2. Add JAVA_HOME and MAVEN_HOME in environment variable: 
o Right click on MyComputer -> properties -> Advanced System Settings -> 


[6] 


Environment variables -> click new button 
Now add MAVEN_HOME in variable name and path of maven in variable value. It 
must be the home directory of maven i.e. outer directory of bin. For example, 
E:\apache-maven-3.1.1 which will displayed below: j 

i ` |ie rpete RDE TA 


[Corpa Nan | harsu ASerce! Syg Pensar | Farce 


Fig. 5.1 (b) 


o Nowclick on oK button. 
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3. Add Maven path in the environment variable: installing Maven on Ubuntu 


o If path is not set, click on the New tab, then set the path of Maven. If it is set, edit In a terminal, we run apt-cache search maven to get all th 

the path and append the path of Maven. A ON . a get all the available Maven 
o Here, we have installed JDK and its path is set by default, s are Boing to paani he search ma 

append the path of Maven. ' $ aptecas Sn 
© The path of Maven should be %maven home%/bin. For example, E:\apache. sees 

maven-3.1.1\bin. o libxmlbeans-maven-plugin-java-doc 


: Documentation for Maven XMLBeans 


bam ee = Plugin. 
Tas shad one . o maven : Java software project management and comprehension tool. 


£ mannara aE on 
ne ee are E m ` 


o maven-debian-helper : Helper tools for building Debian packages with Maven. 
o maven? : Java software project management and comprehension toolCopy. 
. The Maven package always comes with the latest Apache Maven. 
+ Werunthe command sudo apt-get install maven to install the latest Maven: 
$ sudo apt-get install mavenCopy 
This will take a few minutes to download. Once downlcaded, we can run the evn - 
version to verify our installation. 
| MAVEN BUILD REQUIREMENTS 
e Following steps will give an idea about the steps required to check requirements 
before installing Maven. 
Step1 : Verify Java installation in your machine. 
o First of all, open the console and execute a Java command based on the 
operating system you are working on. 
os Task | Command 


Windows | Open Command Console | c\> java -version 


4. Verify Maven: 


o Toverify whether Maven isi 
Rise dase ven is installed or not, open the command prompt and write: 


o Now it will display the version of May, 
Java home as shown below 


Linux | Open Command Terminal | $java-version 

Mac Open Terminal | machine:< joseph$ java - 
| version 
o Letus verify the output for all the operating systems: 


Windows 


en and jdk including the Maven home and 


i SS |. ce 
seroeott kincowy [bers Ae ) = 
Carrig ic) 29 Ricresett Corporat ion. All rights res j : 
Cr Users yss [Teva -very i ` 
feeske Pamen 2.1-1 (CFE ITIS71 fbl 64 13bacecO229S7 
, iie S16 723d98; 2013-09-17 20:52:2 
„1J bi. 


l ation 
"A r 
pee hy © 


java 110.11 2021-04-20 LTS 

Java(TM) SE Runtime Environment 18.9 (build 11.0.11+9- 
LTS-194) 

Java HotSpot(TM) 64-Bit Server VM 18.9 (build 11.0.11+9- 
LTS-194, mixed mode) 


java 11.0.11 2021-04-20 LTS 
Tatati SE Runtime Environment 18.9 (build 11.0.11+9 


-194 l 
i Reais 64-Bit Server VM 18.9 (build 11.0.11+9 


LTS-194, mixed mode 


loserahle e TE an interns] oS iat sees fanity: "windows? 
creel Epp © eetet i sails, 


Fig. 5.1 (d) 


= 
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uild Tool - Maven 
o Ifyou do not have Java installed on your system, then download the Java Step 5 : set Maven Environment Variables, 
Software Development Kit (SDK) from the following. jj nk o Add M2_HOME, M2, MAVEN- OPTS to environment variabl 
http://www.oracle.com. We are assuming Java 11.0.11 as the installeq mosis - = 
version. ; ' Windows 


Set the environment variables using system properties 
M2_HOME=C:\Program Files\Apache Software l 
Foundation\apache-maven-3.8.4 M2=%M2_HOME%\bin 
MAVEN_OPTS=-Xms256m-XmxS12m 
Open command terminal and set environment variables. 
export M2_HOME=/usr/local/apache-maven/apache- 
maven-3.8.4 export M@2=$M2_HOME/bin 
export MAVEN_OPTS=-Xms256m -Xmx512m 
step 6 : Add Maven bin Directory Location to System Path. 
o Now append M2 variable to System Path. 


Windows | Append the string ;%M2% to the end of the system 
variable, Path. 
Windows | Append the string C:\Program export PATH=$M2:$PATH 


Files\Java\jdk11.0.11\bin at the end of the system] ° |. ` export PATH=$M2:$PATH 
variable, Path. Step7 : Verify Maven Installation. 


export PATH = $PATH:$JAVA_HOME/bin/ o Nowopen the console and execute the following mvn command. 


Open Command Console | c\> mvn -version — 


Step2 : SetJAVA Environment. 
o Set the JAVA_HOME environment variable to point to the base directory 
location where Java is installed on your machine. For example, 


Windows | Set the environment variable JAVA_HOME to C:\Program 
Files\Java\jdk11.0.11 


export JAVA_HOME = /usr/local/java-current 
Mac export JAVA_HOME = /Library/Java/Home 


o Append Java compiler location to the System Path. 


not required 


ee E ee ee nen commandTerminel | $ mvn version | 

i >- | Open Terminal machine:~ joseph$ mvn -- 
Step3 : Download Maven Archive. 2 
o Download Maven 3.8.4 from https://maven.apache.org/download.cgi. o Finally, verify the output of the above commands, which should be as 


` Archive name follows: 


apache-maven-3.8,4-bin.zip 


apache-maven-3,8.4-bin.tar.gz 


apache-maven-3.8.4-bin.tar.gz 
Step 4: Extract the Maven Archive. 


Apache Maven 3.8.4 . 
(ob656c72454eSbacbed989064718159e8955971 


Maven home: C:\Program Files\Apache Software 


i - 3.8.4 
Foundation\apache maven ne 
Java version: 11.0.11, vendor: Oracle Corporation, runtime: 


C:\Program Files\Java\j dk11.0.11\ 


Default locale: en_IN, platform ae ; 
os name: "windows 40", version: 4%. 


, "windows" 


Windows 


7 oe os archive, to the directory you wish to install Maven 3.8.4. The 
ctory apache-maven-3.8.4 will be created from the archive. 


s5 Location (can be different based on your installation) 
indows | C:\Program Files\A } 

pache Softw. 3 a 
(ead maven-3.8.4 are Foundation\apach 


/usr/local/apache-maven 
/usr/local/apache-maven 


ding: Cp1252 
" arch: "amd64", 


Maven 3.8.4 è 
A risks ced SESHEATIECS STS” 
0.11 


/local/java-curent/jre 
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| 5.4 | MAVEN POM BUILDS om.xml 


e POM stands for Project Object Model. I ‘oct as pom.xml. 
XML file that resides in the base directory of aaa į a cant i ior 
e The POM contains information. about the project and: various ‘acan detai] 


used by Maven to build the project(s). 


* POM also contains the goals and plugins. While executing a task or goal, Maven looks 


for the POM in the current directory. It reads the POM, gets the needed configuration 
information, and then executes the goal. Some of the configuration that can be 
specified in the POM are following: 
o project dependencies 
o plugins 
o goals 
o build profiles 
o project version 
o developers 
o mailing list - 
e Before creating a POM, we should first decide the project group (groupld), its name 


(artifactId) and its version as these attributes help in uniquely identifying the project . 


in repository. 
POM Example: 


<project xmlns = “http://maven.apache.org/POM/4.0.0" . 


xmlns:xsi = “http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation = “http://maven.apache.org/POM/4.0.0 
http: //maven.apache.org/xsd/maven-4.0.8.xsd"> 
<modelVersion>4.@.0</modelVersion> 


<groupId>com. companyname. project-group</groupId> 
<artifactid>project</artifactId> i 
<version>1.0</version> 


</project> 


o Itshould be noted that there should be a single POM file for E project 


o All POM files require the project element and three mandatory fields: groupld, 


artifactId, version. 


Projects notation in repository is groupld:artifactI arenas 


t is fundamental unit of work in Maven. It jg X 


Node and Description 


project root 


ae j tag. You need to specify the basi 
his is project root | to specify the basic schema sett; 
„ache schema and w3.org specification. a Settings such as 


Model version . 
mA Model version should be 4.0.0. 

groupld ns i 
This is an Id of project's group. This is generally unique amongst an 
arpana cla ARAA example, a banking group com.company.bank 
has all bank related projects. 
artifactid a Ae 
This is an Id of the project. This is generally name of the project. For 
example, consumer-banking. Along with the groupld, the artifactid defines 
the artifact's location within the repository. 
version. - ; i 
This is the version of the project. Along with the groupld, It is used within an 
artifact's repository to separate versions from each other. 
For example, l 
com.company.bank:consumer-banking:1.0 
nany.bank:consumer-banking:1.1. 


Command: mvn help:effective-pom 
o Create a pom.xml in any directory on your computer. Use the content of above 


mentioned example POM. 


MAVEN BUILD LIFE CYCLE 
e A Build Lifecycle is a well-defined sequence of phases, which a the be - 
which the goals are to be executed. Here phase represents a stage in ecy = mee 
example, a typical Maven Build Lifecycle consists of the following seq 


phases. a À 


aes Table 5.2: Phases in Maven Build Life 
[hae [Handles | 3 


i mized in this phase. 
Prepare- | Resource copying | Resource copying can be customize 
resources 7 


l recti if all necessary 
Validating the Validates if the project 1s correct and if 
information 


information is available. 
| Compile | z 


ilation is done. 
P In this phase, source code = A RNE a 
- Test Testing Tests the compiled sourc 
i framework. 
Packaging 
Installation 


This phase creates the I 


‘ng in POM 
i in the packaging n : 
mentioned package = 
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* There are always pre and post phases to register goals, PRES RUA RON. DRIGE tS) ot 
after a particular phase. 

© When Maven starts building a project, it steps throu 
and executes goals, which are registered with ea ch phase. 

e Maven has the following three standard lifecycles: 

L clean 

2. default(or build) 

3. site 

A goal represents a specific task which contributes to the building and managing of a 

project. It may be bound to zero or more build phases. A goal not bound to any build 

phase could be executed outside of the build lifecycle by direct invocation. 

* The order of execution depends on the order in which the goal(s) and the build 
phase{s) are invoked. For example, consider the command below. The clean and 
package arguments are build phases while the dependency:copy-dependencies js a 


gha defined sequence of Phases 


goal 
evn clean dependency: copy-dependencies package 
Here the clean phase will be executed first, followed by the dependency:copy 
dependencies goal and finally package phase will be executed. 

Clean Lifecycle: 

°- When we execute mvn post-clean command, Maven invokes the clean lifecycle 
consisting of the following phases: 


o pre-clean 
o Clean 
o post-clean 


e Maven clean goal (clean:clean) is bound to the clean phase in the clean lifecycle. Its 
clean:cleangoal deletes the output of a build by deleting the build directory. Thus, 
when mvn clean command executes, Maven deletes the build directory. 

° We can customize this behavior by mentioning goals in any of the above phases of 
clean life cycle. 

In the following example, We will attach maven-antrun-plugin:run goal to the pre- 
clean, clean, and post-clean phases. This will allow us to echo text messages 
displaying the phases of the clean lifecycle, 

¢ You can try tuning mvn clean co 
e ies si eo ornare m will display pre-clean and clean. 

Default (or Build) Lifecycle: 


¢ This is the primary lifecycle of Mave 
bless n and is used to build the application. It has the 
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pre Table 5.3; Lifecycle Phases 


Lifecycle Phase and Description 


ee 


—— 
validate 
validates whether project is correct and all necessary information is available 


to complete the build process. 
initialize 
{Initializes build 


generate-sources 
Generate any source code to be included in compilation phase. 


process-sources 
process the source code. For example, filter any value. 


generate-resources 
Generate resources to be included in the package. 


state, for example set properties. 


process-resources 
Copy and Process the resources into the destination directory, ready for 


packaging phase. 


compile 
Compile the source code of the project. 


process-classes 
Post-process the generated files from compilation. For example, to do 


bytecode enhancement/optimization on Java classes. 


generate-test-sources 
Generate any test source code to be included in com pilation phase 


10. | process-test-sources 
ple, filter any values. 


7. 


p 


Process the test source code. For exam 
11. ‘| test-compile apy 
. process-test-classes 2 
test Te 


prepare-package 

Perform any aiis necessary to prepare a package before the ibaa 
packaging. 
package ; 
Take the compiled code and pa 
AR, WAR, or EAR file. 
pre-integration-test 
Perform actions required before inte 
setting up the required environment. 


chasa 


ckage it in its distributable format, su 


gration tests are executed. For example, 


contd. ... 


5. 
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SEADen ssary into an environment wh 
; ckage if neces ere 
Process and deploy the pa 
integration tests can be run. 
- ion-test 
a required after integration tests have been executed, For 


example, cleaning up the environment. 


ackare is valid and meets quali 


Install the package into the local repository, which can be used as a 
Í z P 
dep 7 


| Copies the final package to the remote repository for sharing with other 
| developers and proj 


In Maven terminology, a repository is a directory where all the project jars, library jar, 
plugins or any other project specific artifacts are stored and can be used by Maven 
easily. 
Maven repositories are of three 
regarding these three types. 
L Local 
2 Central 
3. Remote 


types. The following diagram will give an idea 


Central 
Repository 


Fig. 5.2 (a): Marve 
1. Local Repository: n Repositories 


e Maven local repository is a folder 
run any maven command for the fj 


location on 
irst time. your machine, It gets created when you 


" Build Toot. Maven 
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pee al repository keeps your project's all dependencies (library jars, plugin jars 
, Maven loc ou run a Maven build, then Maven automatically downloads all the 
etc). When g s into the local repository. It helps to avoid references to dependencies 
depen e machine every time a project is build. 
stored on p epository by default gets created by Maven in %USER_HOMEY directory. 
» Maven oe pai default location, mention another path in Mayen settings.xml file 
To ner at %™M2_HOME%\conf directory. 
available eine = "http: //maven.apache.org/SETTINGS/1.0.0" 
io = “http: //www.w3.org/2661/X%MLSchema- instance” 
eA EPA = "http://maven.apache.org/SETTINGS/1.0.0 
http://maven.apache.org/xsd/settings-1.6.6.xsd"> 
<localRepository>C: /MyLocalRepository</localRepository> 
</settings> p 
. When you run Maven command, Maven will download sariari ee 
. es local repository is located 7 your local system. It is created by the maven 
u run any maven comman 4 
è Talk ie local repository is %“USER_HOME%/m2 directory. For 
example, C:\Users\SSS IT\.m2. 


Update/Location of Local Repository: i b 
* We can change the location of maven local TEROINY ; 
file. It is located in MAVEN_HOME/conf/settin 
maven 3.1.1\conf\settings.xml. 

Let's see the default code of settings . xml file. 
Settings.xml 


see 


i ingsoanl 
changing the settings 
for example: E:\apache- 


INGS/1.0.0" 
<settings xmlns="http://maven.apache .ore/SeT 0 o. 
XmIns:xsi="http://www.w3.org/2001/XMLSchema- 
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INGS/ 
xsdtschemaLocation="http://maven.apache.org/SETT 


1.0.0 http://maven.apache.org/xsd/settings-1.0.0, x<qu, 


<l-- localRepository 
| The path to the local re 
| 
| Default: ${user.home}/.m2/repository 
<localRepository>/path/to/local/repo</localRepository> 
--> 


pository maven will use to store artifacts, 


eae 


</settings> 
e Now change the path to local repository. After changing the path of local repository, 


it will look like this: 
settings.xml 


<settings xmlns="http://maven.apache.org/SETTINGS/1.0.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://maven.apache.org/SETTINGS/1.0.0 
http://mven.apache.org/xsd/settings-1.0.0.xsd"> 
<localRepository>e:/mavenlocalrepository</localRepository> 
</settings> , 
e Now the path of local repository is e:/mavenlocalrepository. 
2. Central Repository: 
* Maven central repository is repository provided by Maven community. It contains a 
large number of commonly used libraries, ‘on 
° When Maven does not find any dependency in local repository, it starts searching in 
central repository using URL - https: //repol.maven.org/maven2/ 
e Main concepts of Central repository are as follows : 
o This repository is managed by Maven community. 
o Itis not required to be configured. 
o Itrequires internet access to be searched. 
e To browse the content of central maven repository, 
URL - https: //search.maven.org/#browse. Using t 
all the available libraries in central repository. 


MAVEN GLOBAL REPOSITORY 


maven community has provided a 
his library, a developer can search 
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repository is located on the web. Most of libraries can be missing from 


povOP 
emote 
avenT ository such as JBoss library etc, so we need to define remote repository 


the central rep 


Nowing is the code to add the jUnit library in pom. xm1 file, 
Follo 


pom.xml oct xmins="http://maven.apache.org/POM/4.0,0” 
<proj vysie"http: //www.W3.org/2001/XMLSchema- instance” 
To chenaLocation="http : / /maven. apache .org/POM/4.@.0 


xsi che.org/xsd/maven-4.0.0.xsd"> 


nttp://maven.apa 
emodelversion>4.@.@</modelVersion> 
roupId>com. javatpoint . application1</groupId> 

centifactIdomy-application1</artifactId> 
eversion>1.e</version> 
<packaging>jar</packaging> 

<name>Maven Quick Start Anchetype</name> 

* gurlohttp://maven.apache.org</url> 


<dependencies> 
' <dependency> 
<groupId>junit</groupId> 
<artifactId>junit</artifactId> 
<version>4.8.2</version> 
<scope>test</scope> 
</dependency> 
</dependencies> 


</project> ae ee 


GROUP ID, ARTIFACT ID, SNAPSHOT 
* The groupld is a parameter indicating the group or individual that c 
which is often a reversed company domain name. d we use the standard 
* The artifactid is the base package name used in the project, an 
archetype, : d: 
l ak. In order to build a simple Java project, let's run the following AE 
' mvn archetype: generate \ 
-DgroupId=com.baeldung \ 


-DartifactId=baeldung \ 
t \ 
-DarchetypeartifactId=maven-archetype-quickstar 


~DarchetypeVersion=1.4 \ 
~DinteractiveMode=false 


reated a project, 


Build 
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The 2 is used to uniquely identify our projects arie Fa Pro 2. 
« na 4 TOUDI is us ( y s í = ¢ ra CF « ©, SOW u say » 
° The ace is following the rule of the java eee any a is not Re it Will men SREE 
bas oe. ee th Nt xin name which was reserved. $ t meen tha penny 
a eg x ae hee es which were not following the salen 
rule, there are multiple legacies l 
instead of the same, we are using group ids of a single aye inatelon a 
eee a AT meee, 4 ` d 
for getting the single word group ID which was approv ; S 
repository of maven. ` 
* While using the maven group id, we can create multipie SYPBTOHPS 28 per oup 
requirement. The best way to determine the granularity EA use the 
structure of the project. The maven project configuration 1s y using the projec 


object model which was represented by a file name as ieee se ae Will be 
describing the dependency which was managed by the Se che 3 = used in 
plugin configuration for building the software. The pom ue also defines the 
relationship between multi-module projects. 
Key Points: ae ; 
e The pom.xml is maven default XML, all the pom is inheriting from the default or 
parent. This pom is nothing but the default pom which was inherited by default. 
* Maven groupid uses the default pom for executing the relevant goal which was ; Fig. ee the groupid we are checking the i 
defined in a maven groupid. ak this step, while opening the proje ' 
Maven Groupld Naming: » 3. 


ile as follows. 
At the time of working with maven groupid, the important thing about the class file is SE we 
that we don’t need to pick the name from them; it will be taking their name Fa ta See Hoge Seed Peet a arate ete N A zoro? ; 
automatically from 1:1 mapping from the file of Java. Maven is asking us to pick the CEEOL AAA Sia 
two names, so it is very simple for us. For defining the maven grouped naming, we ` 


pata tae to and praht ond ampet rm a OE 


ee) e) 


a 


—_____) 


for Us 
entr 


Sheopteoe I egies e or Tuo era’ i 
Zia 1 Pal nai ee M f 
E sea! D giec bee Dz owe gate ep IITE AI wae peer 8 hats Í 
need to follow the below steps: raD a cso on NTT Neon tween ace rp at | 
. ` . . . E ace . ‘ herin e Be lees Torsone 3 
1. In this step, we are creating the template of the project in the spring initializer, eben a So seeae im É 
The below figure shows the template of the maven grouped naming project as ? Ribsentbay eed U O ryrie eeuen 
salons : — Sinn ake we tem = 
Group name ~com.groupid ee no perapi z 
_ artifact => 
Artifact- maven -groupid Eas E a 
Name - maven_groupid 


m uO  merape pagitne eerie 
Teno “i sinc Gtleodrafert fer teen pasih autre 


Packaging -jar 
Java version -8 


| ; PA nadae i ample. We are 
i 4, We are defining the naming conventions In the following examp 
a a l defining the name as maven_groupid as follows: 
aq o 


Omes Cure Civeemr Gr Code; $ 
Onemacr Ore 


<parent> PE 

<groupId>org.springframework .boot</g 3 

cartlfactIdssncing boot. starter -parente/aptifactl@> 

<version>2.7.3</version> l 

<relativePath/> 

</parent> 

<BroupId>com; groupid</groupId> 

, sartifactId>maven_groupid</artifactId> 

Fig. 5.3 (a) <version>@.@.1-SNAPSHOT</version> 
<nameomaven_groupid</name> 
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a 0 x 
G eeter -eam papa ponas -igro iaa fate b 
fe [2 p pyn ka bd pa paio ey 
Mec BOOS KII SE EEI K UE D EE Sa 


EISD furpemmn: 
1 hal eorsigee 1.0" encetiogs U7") ; TRE 
0 gains mias Urey faor cache. p INLA msni Re:a yR e 
ul thong cert ions Prt // ore. Erp PNIA beeps [noes pach ry rient 8.8. 


ore. irl eae 


tpesloepiphyremetictper? 
Ceti tbagriog toot starter porest dyti 
wimg.. Jerie 

elite) ti lek pret t naitry +? 


raw ant greg ld jae 
cdruriytiontragect fy ena pogu prior 


Fig. 5.3 (d) 
We are changing the name of maven, and the groupid in the following example. 
Code: 
<parent> 


<groupId> org.springframework.boot </groupId> | 
<artifactId>spring-boot-starter-parent</artifactId> 
<version>2.7.3</version> 

<relativePath/> <!-- lookup parent from repository --> 


</parent> 

<groupId>com.maven</groupId> 
<artifactId>maven_groupid</artifactId> 
<version>@.@.1-SNAPSHOT</version> 
<name>maven_group</name> 

<description>Project for maven_groupid</description> 
_<properties> : 

Q rotja -ree gaps pnm. trg Tad saet 

Ble Ut free Degre Sor paea pa ako pep 

eM ETARE E GOA bb KNEE Ea DAE a 


E[S ften posme i e 
Monier mlake: gache srp FOYE OLN" mls: uie egaa. org II She-is" 
viriel trey: aer pate p PILAA kepsan gode ngirit 
mt berurat note et 
4 orro 
CERO. tern meert seeti pogi 
araara iu E atai a aa a aai i TD 
Arna? hnim . 
eUr C+ Jaka pret fa resiu o 
(wre 
gasis pogo 
artitatiqene papih rti rth 
or lol OL SIT erria 
oom anes grog. ve: | 
aarti Prefect fer saa papi ieiz 
ite | graetiew 
et erie ijra rim 


OM ret 


` Fig. 5.3 (e) 


We can choose any name at the time W 
Eri ; } e can choose any nam 
| Ea of defining Groupld, 7 T ERES 
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pifferentiate between Grouptd and Artifactid: —— 


Table 5.4 


zo ArtifactId 
EE is identifying the project | ArtifactId is the name of the jar 
uniquely. without a version. 


2. Groupld has various versions. 


ArtifactId does not have any versions. 
We are defining the Groupld in the | We ar 
pom.xml file. 


e defining the Artifactid in the 
pom.xml file, 


of defining Artifactld. 
We need to define the name of | We need to define the name of 
Groupld in lowercase letters. Artifactld in lowercase letters. 
Maven is not enforcing the rule by | Maven is not enforcing the rule by 
using Groupld, using Artifactld. 
7; We have defined the Groupld in the | We have defined the ArtifactId in the 
plugin section. plugin section. 
The Groupld is nothing but.an id of | The Artifactld is nothing but an id of 
the project. the project. 
The GroupId is nothing but an |The Artifactld is nothing but an 
element of the pom.xml file. element of pom.xml file. 
10. The Groupld specifies the id of a | The Artifactld will specify the if of 
‘ [project group. i 


SNAPSHOT: . } 

e SNAPSHOT is a special version that indicates 4 current development copy. Unlike 

. regular versions, Maven checks for a new SNAPSHOT version in a remote repository 
for every build. A 

e Now data-service team will release SNAPSHOT of its updated code every time to 

repository, say data-service: 1.0-SNAPSHOT, replacing an older SNAPSHOT jar. 


MAVEN DEPENDENCIES 


ʻe One of the core features of Maven is Dependency Management. Managing 


difficult task once we've to deal with multi-module projects 


dependencies is a des a high degree of 


(consisting of hundreds of modules/sub-projects). Maven provi 


control to manage such scenarios. 


Transitive Dependencies Discovery: eee 
li ther i 
library, say A, depends upon 0 } 
a = l requires to use library B too. 


y B. In case another 
e Itisa case, i 
_ project C'wants to use A, then that project 
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scover all the libraries required, Maven 


í 
* Maven helps to avoid such requirements ae of dependencies, figure out thej, 


does so by reading project files (pom.xm 
dependencies and so on. i om. Maven hand] 
* We only need to define direct dependency in each project P es the 
rest automatically. i ies can quickly gro 
f included libraries y grow toa 
» With transitive dependencies, the graph o i ; i : 
large extent. Cases can arise when there are duplicate libraries. Maven Provides few 
features to control extent of transitive dependencies. PEE ne 
Table 5.5: Features to control extent of Transitive Dep = 


Feature and Description 


Dependency Mediation: i ; 
Determines what version of a dependency is to be used when multiple 
versions of an artifact are encountered. In the dependency tree, if two 
dependency versions are at the same depth, then the first declared. 
dependency will be used. 


Dependency Management: 


Directly specify the versions of artifacts to be used when they are 
encountered in transitive dependencies. For example, Project C can include B 
as a dependency in its dependency management section and directly control 
which version of B is to be used when it is ever referenced. 


Excluded Dependencies: 


Any transitive dependency can be excluded using "exclusion" element. As 


example, A depends upon B and B depends upon C, then A can mark C as 
excluded. 


Optional Dependencies: 


Any transitive dependency can be marked as optional using "optional" 
element. For example,.A depends upon B and B depends upon C. Now B 
marked C as optional. Then A will not use C. 

Dependency Management: 


Usually, we have a set of projects under a common project. In such case, we can create 
a common pom having all the common dependencies and then make this pom, the 
parent of sub-project's poms. Following example will help you understand this 
concept. ` 
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Lib1:1.0 Maven 


eee aN 
App-Core-lib:1.0 


Lib2:2,1 
Lib3:1.1 


Following are the elements 


App-UI-WAR:1.9 


il 


E 
App-Data-lib:1.0 


Fig. 5.4: Dependency Graph 


of the above dependency graph: 
o App-UI-WAR depends upon App-Core-lib and App-Data-lib, 
o - Rootis parent of App-Core-lib and App-Data-lib, 


o Root defines Lib1, Lib2, Lib3 as dependencies in its dependency section. 


When we execute Maven build commands, 


Maven starts looking for dependency 
libraries in the following sequence : 


‘Step1 Search dependency in local repository, if not found, move to Step 2 else 
perform the further processing. 

Step 2 Search dependency, in central repository, if not found and remote 
repository/repositories is/are mentioned then move to Step 4. Else it is 
downloaded to local repository for future reference. 

Step 3 If a remote repository has not been mentioned, Maven simply stops the 
processing and throws error (Unable to find dependency). 


Step 4 Search dependency in remote repository or repositories, if found then it 


is downloaded to local repository for future reference, Otherwise, Maven 
stops processing and throws error (Unable to find dependency). = 
MAVEN PLUGINS 3 7 
Maven is.actually a plugin execution framework where every task is actually done by 
plugins. Maven Plugins are generally used to: 
o create jar file 


ʻo create war file 


ose compile code files 


o unit testing of code 


o create project documentation 


o create project reports 
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goals, which can be executed using the following 
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e Aplugin generally provides a set of 
syntax: 
mvn [plugin-name]:[goal-name] l 
For example, a Java project can be compiled wit 
compile-goalby running the following command: 
myn compiler:compile 
Plugin Types: 
* Maven provided the following two types of Plugins : 
Table 5.6: Types of Plugins 
Type and Description 


h the maven-compiler-plugin's 


Build Plugins j 
They execute during the build process and should be configured in the 


<build/> element of pom.xml. ; 
Reporting Plugins ; : 
They execute during the site generation process and they should be 
configured in the <reporting/> element of the pom.xml. 


Table 5.7: Few common Plugins 
Plugin and Description 


Cleans up target after the build. Deletes the target directory. 
compiler 
Compiles Java.source files. 


surefire 
Runs the JUnit unit tests. Creates test reports. 


4. jar 
Builds a JAR file from the current project. 
war 
Builds a WAR file from the current Project. 


javadoc 
Generates Javadoc for the project. 


antrun 
Runs a set of ant tasks from any phase mentioned of the build 


e Maven is written in Java and is used to build 
etc. 

° Based on the Project Object Model 
developers while developing report 


Projects written in C#, Scala, Ruby, 


(POM), this tool has made the life easy of Java 
s, checks build and testing automation setups: 
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e Maven emphases o 
_ process, rain care of S n i 
Builds 
Documentation 
Dependencies 
Reports 
SCMs 
Distribution 
Releases 
Mailing list 
e Maven was created to simplify Jakarta Tribune project building processes. Many of 
the projects had slightly different ANT files, so Apache developed Maven to handle 
| building multiple projects together, including publishing project information, 
facilitating team collaboration, deploying projects, and sharing JARS among 
several projects, — 
e Features of Maven: 
A huge, continuously growing repository of user libraries. 
The ability to set up projects easily, using best practices. 
Dependency management, featuring automatic updating. 
Backwards compatible with previous versions. 
Strong error and integrity reporting. 
Automatic parent versioning. 
Ensures consistent usage across all projects. . 
It is extensible, and you can easily write plug-ins using scripting languages or 
Java. 


Check Your Understanding | 
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1. Which of the following command can tell the version of Maven? 

(a) mvn --version (b) maven -version 
. (c): mvn version (d) maven --version 

2. Which of the following phase in Maven life cycle runs any checks to verify the 
package is valid and meets quality criteria? 
(a) install (b) verify 
(c) Integration cost (d) deploy 

3. ‘Which of the following scope specifies that dependency is 
compilation, but is required during execution? 

(b) compile 

(d) test 


not required for 


(a) provide 
(c) runtime 
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Which of the following phase in Maven life cycle performs any operations 


| packaging? 
ckage before the actua 
pie N (b) process-resources 
(a) destroy package 
ld, reporting and documentation from a central 


(a) process-test-sources 
(c) prepare-package 
can manage a project's bui 


piece of information. 

(a) Maven (b) PHP 
(c) Scala (d) JAVA 
In Maven, POM stands for : 


(b) Project Object Method 
(d) Process Object Method 


(a) Project Object Model 
(c) Process Object Model 
Which of the following are the phases of Maven Build Lifecycle? 
(a) Validate (b) Compile 

(c) Prepare Resources (d) All of the above 

Which of the following is not type of Maven Repository? 

(a) Remote (b) Local 

(c) Central (d) Dependency i 

Which of the following command removes the target directory with all the build 
data before starting the build process? 

(a) mvn clean 
(c) mvm build (d) mvn site 

Which one of the following is a naming scheme in which the implicit name for a 
mock object is the mocked type’s name prepends with “mock”. 

(a) RetroNaming Scheme 

(c) CamelCaseNamingScheme 


(b) mvm compile 


(b) JavaReflectionImposteriser 
(d) LastWordNamingScheme 
Answers i 


Practice Questions | 


0 [solo [e0 |20 [oa] 


Q.I Answer the following questions in short. 


vw 


What is Maven? 
How to confirm whether Maven is installed or not? 
What is POM? 


State the configuration that can be specified in the POM. 
What is Group!d? 
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6. What is artifactID? aven 


7. Whatis Snapshot? 
8. What is Super POM? 
9. What is Goal? 
QII Answer the following questions. 


PWN EP 


5. 


Explain the phases of Maven build Life cycle. 

State the minimum requirements of POM. 

What features provided by Maven to control extent of transitive dependencies? 
Describe the Dependency Management in Maven. | 
Explain two types of Plugins provided by Maven? 


Q.III Write short notes on: 


1. 


2. 
3. 
4 


Maven Local Repository 
Central Repository 

‘Maven Global Repository 
Maven Dependencies 
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